We are building LLM evaluation and training datasets to train LLMs to work on realistic software engineering problems. One of our approaches is to create verifiable SWE tasks based on public repository histories in a synthetic manner with human-in-the-loop, expanding dataset coverage across different task types, programming languages, and difficulty levels. About the Role: We seek experienced software engineers (tech lead level) familiar with high-quality public GitHub repositories to contribute to this project. Experience with well-maintained, widely-used repositories with 500+ stars is required. This role involves hands-on software engineering tasks, including environment automation, issue triaging, and evaluating test coverage and quality. Why Join Us? Turing is one of the world’s fastest-growing AI companies, advancing and deploying powerful AI systems. You will evaluate how LLMs interact with real code, influencing the future of AI-assisted software development. This role offers a unique blend of practical software engineering and AI research. Day-to-day responsibilities include: Analyzing and triaging GitHub issues across trending open-source libraries. Setting up and configuring code repositories, including Dockerization and environment setup. Evaluating unit test coverage and quality. Modifying and running codebases locally to assess LLM performance in bug-fixing scenarios. Collaborating with researchers to identify repositories and issues challenging for LLMs. Potentially leading a team of junior engineers on various projects. Required Skills: Experience with well-maintained, widely-used repositories with 500+ stars. Proficiency with Git, Docker, and software pipeline setup. Ability to understand and navigate complex codebases. Comfort with running, modifying, and testing real-world projects locally. Experience contributing to or evaluating open-source projects is a plus. Note: Experience with repositories having 500+ stars is mandatory. Nice to Have: Participation in LLM research or evaluation projects. Experience building or testing developer tools or automation agents. Perks of Freelancing With Turing: Remote work environment. Opportunity to work on cutting-edge AI projects with leading LLM companies. Commitment of 20 hours/week with some overlap with PST hours. Contractor role (no medical or paid leave). Contract duration: 1 month, starting next week. Seniority Level Mid-Senior level Employment Type Contract Job Function Engineering and Information Technology Industry Software Development #J-18808-Ljbffr Turing
...Nation Entertainment, our people embrace these qualities, so if this sounds like you then please read on!THE ROLEAs the Tour Sponsorships Manager, you will be responsible for identifying, securing, and managing sponsorship opportunities across all tour dates and cities...
...Driver - Make Money On Your Schedule at Uber summary: As a driver for Uber, you have the flexibility to earn money on your... ...driving job, part-time driver, earn money driving, self-employed driver, independent contractor, driving app, transportation gig, car rental...
...family leave per year. Join our team today! POSITION OVERVIEW Assists with monitoring and maintaining plant operations and assists in the repair of power plant and fabrication of special projects. Participates and successfully completes City sponsored apprenticeship...
...Wellness Center Pay Range $11.50-$12.50 Part Time 10+ hours per week with potential to increase hours Our Wellness Attendants provide a safe and positive experience for all members. Be present and approachable if members need assistance or guidance with equipment...
Juvenile Court OfficerThis position is located in Williston, NDApply: The North Dakota Court System offers employment opportunities that provide a rewarding career in public service working together to deliver justice. The Court System offers an excellent benefits...