Website:
fetchjobs.co
Job details:
Software Engineer - LLM Evaluation and Training DatasetsAbout the Company
Turing is a leading technology company dedicated to advancing artificial intelligence and machine learning solutions. Renowned for its innovative approach, Turing focuses on building cutting-edge AI systems that revolutionize various industries, including software development, data science, and automation. The company prides itself on fostering a dynamic and inclusive work environment that encourages creativity, collaboration, and continuous learning. With a global presence and a diverse team of talented professionals, Turing is committed to pushing the boundaries of what AI can achieve and making a meaningful impact on the future of technology.
About The Role
We are seeking an experienced software engineer at the tech lead level to join our team working on the development of large language model (LLM) evaluation and training datasets. This role is pivotal in creating datasets that enable LLMs to address realistic software engineering challenges. The ideal candidate will have a strong background in working with high-quality public repositories from platforms like GitHub and will be responsible for hands-on development, environment automation, issue triaging, and assessing code quality. The role offers an exciting opportunity to contribute directly to pioneering AI research that enhances the capabilities of LLMs in understanding and generating complex codebases.
Qualifications
The ideal candidate should possess a minimum of 3+ years of professional experience in software engineering. Proficiency in at least one programming language such as Ruby is required. Candidates should have a solid understanding of version control systems like Git, containerization tools such as Docker, and experience setting up and managing software pipelines. The ability to comprehend and navigate complex codebases, as well as run, modify, and test real-world projects locally, is essential. Experience contributing to or evaluating open-source projects is considered a plus, along with familiarity with AI or LLM research projects.
Responsibilities
- Analyze and triage GitHub issues across trending open-source libraries to identify relevant challenges for LLM evaluation.
- Set up and configure software repositories, including environment setup and Dockerization, to facilitate testing and development.
- Evaluate unit test coverage and overall code quality to ensure datasets are based on robust and reliable codebases.
- Modify and execute codebases locally to assess LLM performance in bug-fixing and code comprehension scenarios.
- Collaborate closely with researchers to identify repositories and issues that pose challenges for LLMs, aiding in dataset expansion.
- Lead and mentor junior engineers, fostering a collaborative environment to achieve project goals efficiently.
Benefits
Joining Turing provides the opportunity to work remotely in a flexible environment, allowing you to balance your professional and personal life effectively. You will be part of a forward-thinking team working on cutting-edge AI projects with some of the world’s leading LLM companies. This role offers exposure to innovative research and development in AI, providing valuable experience that can accelerate your career in technology. Additionally, Turing promotes continuous learning and professional growth through collaboration with top-tier experts and participation in groundbreaking initiatives.
Equal Opportunity
Turing is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate based on race, gender, sexual orientation, religion, age, disability, or any other protected characteristic. We believe in fostering a workplace where everyone feels valued, respected, and empowered to contribute to our shared success.
Click on Apply to know more.