Remote Senior Software Engineer (LLM) - 34953
New Today
Remote Senior Software Engineer (LLM) - 34953Remote Senior Software Engineer (LLM) - 34953 3 days ago Be among the first 25 applicants
Get AI-powered advice on this job and more exclusive features.
Sign in to access AI-powered advices Continue with Google Continue with Google
Continue with Google Continue with Google
Continue with Google Continue with Google
Continue with Google Continue with Google
Continue with Google Continue with Google
Continue with Google Continue with Google
Turing is one of the world’s fastest-growing AI companies, pushing the boundaries of AI-assisted software development. Our mission is to empower the next generation of AI systems to reason about and work with real-world software repositories. You’ll be working at the intersection of software engineering, open-source ecosystems, and frontier AI.
Project Overview:
We're building high-quality evaluation and training datasets to improve how Large Language Models (LLMs) interact with realistic software engineering tasks. A key focus of this project is curating verifiable software engineering challenges from public GitHub repository histories using a human-in-the-loop process.
Why This Role Is Unique:
Collaborate directly with AI researchers shaping the future of AI-powered software development.
Work with high-impact open-source projects and evaluate how LLMs perform on real bugs, issues, and developer tasks.
Influence dataset design that will train and benchmark next-gen LLMs.
What does day-to-day look like:
Review and compare 3–4 model-generated code responses for each task using a structured ranking system.
Evaluate code diffs for correctness, code quality, style, and efficiency.
Provide clear, detailed rationales explaining the reasoning behind each ranking decision.
Maintain high consistency and objectivity across evaluations.
Collaborate with the team to identify edge cases and ambiguities in model behavior.
Required Skills:
At least 3 years of experience at top-tier product or research companies (e.g., Stripe, Datadog, Snowflake, Dropbox, Canva, Shopify, Intuit, PayPal, or research roles at IBM, GE, Honeywell, Schneider, etc.), with a total of 7+ years of overall professional software engineering experience.
Strong fundamentals in software design, coding best practices, and debugging.
Excellent ability to assess code quality, correctness, and maintainability.
Proficient with code review processes and reading diffs in real-world repositories.
Exceptional written communication skills to articulate evaluation rationale clearly.
Prior experience with LLM-generated code or evaluation work is a plus.
Bonus Points:
Experience in LLM research, developer agents, or AI evaluation projects.
Background in building or scaling developer tools or automation systems.
Commitment: ~20 hours/week (partial PST overlap required)
Type: Contractor (no medical/paid leave)
Duration: 1 month (starting next week; potential extensions based on performance and fit)
Rates: $40–$100/hour, based on experience and skill level.
Seniority level Seniority levelMid-Senior level
Employment type Employment typeContract
Job function Job functionInformation Technology and Engineering
IndustriesSoftware Development
Referrals increase your chances of interviewing at Turing by 2x
Sign in to set job alerts for “Software Engineer” roles. Continue with Google Continue with Google
Continue with Google Continue with Google
New York, NY $140,000 - $185,000 4 days ago
New York, NY $145,000 - $260,000 8 months ago
New York, NY
Read on to find out what you will need to succeed in this position, including skills, qualifications, and experience.
$110,000.00
-
$240,000.00
3 months ago
New York, NY
$150,000.00
-
$175,000.00
1 month ago
New York, NY
$120,000.00
-
$240,000.00
3 weeks ago
React JS Developer (Full Time) - 100% Remote New York, NY
$150,000.00
-
$260,000.00
4 months ago
New York, NY
$70,000.00
-
$150,000.00
4 months ago
Software Engineer (L5), Content & Business Products New York, NY
$170,000.00
-
$720,000.00
2 weeks ago
New York, NY
$155,250.00
-
$174,273.00
1 day ago
Full Stack Software Engineer (PST or MST timezones) New York, NY
$125,000.00
-
$175,000.00
2 weeks ago
New York, NY
$75,000.00
-
$120,000.00
3 weeks ago
Latin America $80,000 - $280,000 1 year ago
Full stack engineer - React/Node/Mongo [Remote] New York, NY $50,000 - $65,000 2 weeks ago
We’re unlocking community knowledge in a new way. Experts add insights directly into each article, started with the help of AI.
#J-18808-Ljbffr
Remote working/work at home options are available for this role.
- Location:
- New York, NY, Remote
- Salary:
- $80
- Job Type:
- FullTime
- Category:
- Information Technology