About the role
Apollo Research is hiring a Software Engineer. Join cord to speak directly with Joping, People & Ops Manager at Apollo Research.
About Apollo Research
The capabilities of current AI systems are evolving at a rapid pace. While these advancements offer tremendous opportunities, they also present significant risks, such as the potential for deliberate misuse or the deployment of sophisticated yet misaligned models. At Apollo Research, our primary concern lies with deceptive alignment, a phenomenon where a model appears to be aligned but is, in fact, misaligned and capable of evading human oversight.
Our approach focuses on behavioral model evaluations, which we then use to audit real-world models. We also combine black-box approaches with applied interpretability. In our evaluations, we focus on LM agents, i.e. LLMs with agentic scaffolding similar to AIDE or SWE agent. We also study model organisms in controlled environments (see our security policies), e.g. to better understand capabilities related to scheming.
At Apollo, we aim for a culture that emphasizes truth-seeking, being goal-oriented, giving and receiving constructive feedback, and being friendly and helpful. If you're interested in more details about what it's like working at Apollo, you can find more information here.
About the Team
The current evals team consists of Mikita Balesni, Jérémy Scheurer, Alex Meinke, Rusheb Shah, Bronson Schoen, Andrei Matveiakin, Felix Hofstätter, and Axel Højmark. MariusHobbhahn manages and advises the team, though team members lead individual projects. You would work closely with Rusheb and Andrei, who are the full-time software engineers on the evals team, but you would also interact a lot with everyone else. You can find our full team here.
Responsibilities
Maintain and extend our internal library for building and running language model evaluations.
Work closely with researchers to understand what challenges they face. Rapidly prototype, iterate on and ship useful features to increase their productivity.
Collaboratively iterate on the vision and priorities for the internal software stack.
Advocate for good software design practices and the general health of the codebase.
Implement LLM agents to automate software engineering tasks.
Keep up-to-date with the latest approaches to implementing evals frameworks and LLM scaffolding (e.g. open-source projects and research papers).
If interested, you can also run well-scoped research projects yourself, e.g. build an evaluation or do capability elicitation for an existing evaluation.
Required Skills
At least 2 years of FTE-equivalent experience in software development with Python
Strong candidates may also have:
Note that we welcome and value applications with different backgrounds. We encourage you to apply even if none of the following apply to you.
Experience in rapidly iterating on software products in close collaboration with users. For example, you have built software tools for internal or external users for 1+ years.
Strong communication skills and user/researcher empathy to understand and address their needs.
You enjoy close in-person collaboration and pair programming.
Experience building organization-internal tools. For example, you have led the efforts of an organization-internal tool for at least one 6-month project.
This job is sourced from a job board