Key Responsibilities
- Evaluate and rank AI-generated code solutions across multiple programming languages and problem domains
- Assess code for correctness, efficiency, readability, maintainability, and adherence to best practices
- Identify bugs, anti-patterns, security issues, and performance bottlenecks in AI-generated outputs
- Write detailed, structured feedback explaining technical decisions and quality assessments
- Refine AI-generated code to meet production-level engineering standards
- Provide preference rankings to train AI models on what constitutes high-quality code
Requirements
- 3+ years of professional software engineering experience
- Proficiency in one or more major programming languages (Python, JavaScript/TypeScript, Java, C++, Go, Rust)
- Strong grasp of data structures, algorithms, and computational complexity
- Deep understanding of software design principles, clean code practices, and engineering trade-offs
- Experience with code review and ability to articulate technical decisions clearly