Senior ML Systems Engineer, Inference

RunPod

Salary: $150k - $220k
Experience: 5+ yrs
Location: United States
Job type: Full-time

Required skills

vLLM
SGLang
Python
CUDA
Triton

About the role

5+ years professional systems engineering; deep hands-on experience with vLLM or SGLang; strong Python skills; understanding of LLM inference performance; experience with quantization, speculative decoding, or distributed serving; rigorous benchmarking and GPU profiling.

About RunPod

AI cloud computing platform providing on-demand GPUs and serverless compute to developers, researchers, and AI companies.

This page is fully interactive when JavaScript is enabled. Please enable JavaScript to apply or browse related roles.

Similar jobs

Simulation Specialist, CONUSAechelon TechnologyUnited States · 5+ yrs
Sr. Healthcare Reclamation AnalystMachinifyUnited States · 4+ yrs · $52k - $58k
Pricing EngineerXometryGeorgia · 6+ yrs
Senior Education Professional, DevelopmentNICEAtlanta · 6+ yrs
Senior Detection Engineering & Threat Hunting AnalystHuntressUnited States · 2+ yrs · $150k - $170k
Electron Optics EngineerPDF SolutionsMilpitas · 5+ yrs · $145k - $155k
Deal Strategist NielsenNew York City · 6+ yrs · $88k - $147k
Senior Cloud Solutions SpecialistManaged SolutionUnited States · 4+ yrs · $90k - $105k
Senior Enterprise Applications EngineerNebiusUnited States · 5+ yrs · $147k - $183k
Public School District Classification & Compensation ConsultantAlphaHireUnited States · 5+ yrs
Tribal Child Care Project SpecialistMiami Technology Solutions, LLCVirginia · 5+ yrs
Senior Development Engineer, Physical AI InfraByteDanceSeattle · 5+ yrs