Key Responsibilities
- Design, implement, and maintain Go-based tools for automated repository analysis, issue triaging, and test coverage evaluation.
- Develop and refine synthetic software engineering tasks aligned with real-world code repositories, ensuring dataset quality and task diversity.
- Analyze and triage GitHub issues across high-impact open-source libraries to identify patterns and inform dataset curation priorities.
- Implement and automate development environment setups for consistent task validation and performance testing.
- Collaborate with cross-functional teams to improve LLM evaluation frameworks and incorporate feedback into iterative development cycles.
Requirements
- 5+ years of professional software engineering experience with Go, demonstrated through production-grade projects or contributions to open-source systems.
- Deep familiarity with public GitHub repositories, including issue tracking, version control workflows, and code review processes.
- Experience designing and validating software engineering tasks or benchmarks, ideally in AI or machine learning contexts.
- Proficiency in scripting and automation tools (e.g., Bash, Python) to streamline development and evaluation pipelines.
- Strong problem-solving skills with the ability to work independently and iterate on technical solutions in a dynamic environment.