Website:
agilegridsolution.com
Job details:
About The Company
Turing is one of the world's fastest-growing artificial intelligence companies dedicated to accelerating the development and deployment of advanced AI systems. With a focus on innovative solutions, Turing leverages cutting-edge research to create impactful AI tools that transform industries and redefine technological boundaries. The company fosters a dynamic and collaborative environment where talented professionals can thrive and contribute to groundbreaking projects in AI, machine learning, and software engineering. As a leader in the AI space, Turing is committed to pushing the frontiers of technology, enabling organizations worldwide to harness the power of AI for real-world applications.
About The Role
We are seeking experienced and highly skilled software engineers at the tech lead level to join our innovative project focused on building Large Language Model (LLM) evaluation and training datasets. This role involves working with high-quality public GitHub repositories to develop verifiable software engineering (SWE) tasks based on real repository histories, utilizing a synthetic approach with human-in-the-loop methodologies. The primary goal is to expand dataset coverage across various programming languages, difficulty levels, and task types, thereby enhancing the robustness and versatility of LLM training datasets.
The successful candidate will engage in hands-on software engineering activities, including automating development environments, triaging issues, assessing test coverage and quality, and modifying codebases for evaluation purposes. This position offers a unique opportunity to contribute directly to the future of AI-assisted software development, working alongside researchers to identify challenging repositories and issues for LLM performance assessment. Additionally, there are opportunities to lead junior engineers, fostering a collaborative and innovative team environment.
Qualifications
The ideal candidate will possess a minimum of three years of professional experience in software engineering, demonstrating a strong proficiency in at least one of the following programming languages: Rust. Candidates should have a solid understanding of Git, Docker, and basic software pipeline setup, with the ability to navigate and understand complex codebases effectively. Experience in running, modifying, and testing real-world projects locally is essential. Prior contributions to open-source projects or experience in evaluating open-source repositories will be considered a plus. Familiarity with AI research, LLM evaluation, or automation tools related to developer workflows is advantageous but not mandatory.
Responsibilities
- Analyze and triage issues across trending open-source libraries hosted on GitHub.
- Set up and configure development environments, including Dockerization and environment management.
- Evaluate unit test coverage and quality to ensure comprehensive testing standards.
- Modify and run codebases locally to assess the performance of LLMs in bug-fixing and code understanding scenarios.
- Collaborate with research teams to identify challenging repositories and issues for LLM evaluation.
- Design and implement automation workflows to streamline dataset creation and evaluation processes.
- Lead or mentor junior engineers, fostering a collaborative team environment and sharing technical expertise.
Benefits
Joining Turing provides the opportunity to work remotely in a flexible environment, enabling you to balance professional growth with personal commitments. You will be involved in cutting-edge AI projects with leading LLM companies, gaining exposure to innovative technologies and methodologies. The role offers a chance to contribute to impactful research that shapes the future of AI-assisted software development. Additionally, Turing supports continuous learning and professional development, providing a stimulating environment for talented engineers to expand their skills and influence the AI landscape.
Equal Opportunity
Turing is committed to creating an inclusive and diverse work environment. We are proud to be an equal opportunity employer and do not discriminate based on race, ethnicity, gender, sexual orientation, age, disability, or any other protected status. We believe that a diverse team fosters innovation and creativity, and we welcome applicants from all backgrounds to apply and join our mission to advance AI technology for the betterment of society.
Click on Apply to know more.