Python( LLM Evaluation & Repository Validation)

Skills req

Python ,Git and Docker

Vetting

Online Coding. In case the talent is not receiving the link, you can share this one:

Work remotely with Turing to advance AI

Note: Ensure talent is using the same email that was submitted on agency portal

About the Role:

We are looking for experienced software engineers (tech lead level) who are familiar with high-quality public GitHub repositories and can contribute to this project. You should have experience working with well-maintained, widely-used repos with 5000+ stars. This role involves hands-on software engineering work, including development environment automation, issue triaging, and evaluating test coverage and quality

Why Join Us?

Turing is one of the worlds fastest-growing AI companies accelerating the advancement and deployment of powerful AI systems. You’ll be at the forefront of evaluating how LLMs interact with real code, influencing the future of AI-assisted software development. This is a unique opportunity to blend practical software engineering with AI research.

What does day-to-day look like:

• Analyze and triage GitHub issues across trending open-source libraries.
• Set up and configure code repositories, including Dockerization and environment setup.
• Evaluating unit test coverage and quality.
• Modify and run codebases locally to assess LLM performance in bug-fixing scenarios.
• Collaborate with researchers to design and identify repositories and issues that are challenging for LLMs.
• Opportunities to lead a team of junior engineers to collaborate on projects.

Required Skills:

• Strong experience with Python,
• Proficiency with Git, Docker, and basic software pipeline setup.
• Ability to understand and navigate complex codebases.
• Comfortable running, modifying, and testing real-world projects locally.
• Experience contributing to or evaluating open-source projects is a plus.

Nice to Have:

• Previous participation in LLM research or evaluation projects.
• Experience building or testing developer tools or automation agents.

Perks of Freelancing With Turing:

• Work in a fully remote environment.
• Opportunity to work on cutting-edge AI projects with leading LLM companies.

Offer details:

• Commitment required: 40 hours per week with 4 hrs/day overlap with PST
• Employment type: Contractor assignment (no medical/paid leave)