[Remote] Senior Python Developer (AI Evaluation & Benchmarking)
Note: The job is a remote job and is open to candidates in USA. Lifted, an Upwork Company, is seeking experienced Senior Python Developers to help build the next generation of Artificial Intelligence systems. The role involves designing programming benchmarks, evaluating AI-generated code, and improving the performance of frontier AI models.
Responsibilities
- Design and develop coding benchmarks used to evaluate frontier AI models
- Analyze AI-generated code for correctness, reliability, efficiency, and edge cases.Build and maintain scalable data pipelines that support AI evaluation workflows
- Create structured programming scenarios to test reasoning, debugging, and code quality
- Work with large codebases and multi-language software environments
- Collaborate with teams focused on improving how AI models understand, generate, and evaluate software
- Write clean, maintainable, and well-tested Python code following software engineering best practices
Skills
- 4+ years of professional software engineering experience (required)
- Expert-level proficiency in Python
- Experience working at a high-growth technology company or top-tier software organization
- Proficiency in at least one additional programming language such as JavaScript, Go, C++, or similar
- Experience with CI/CD pipelines and automated testing frameworks such as pytest, Mocha, or JUnit
- Strong understanding of software engineering best practices, debugging, and code quality
- Excellent analytical and problem-solving skills
- Experience with AI/ML evaluation, model benchmarking, or Generative AI
- Background in security engineering
- Significant contributions to open-source software projects
- Experience working with large-scale distributed systems or enterprise software platforms
Benefits
- Fully remote contract opportunity
- Weekly payments for approved work completed during the previous week
Company Overview
- Lifted, an Upwork Company is the first global solution to source, contract, manage, and pay any type of contingent worker. It was founded in 2025, and is headquartered in , with a workforce of 201-500 employees. Its website is https://go-lifted.com.