Senior ML Systems Engineer, Inference

RunPod

Salary: $150k - $220k
Experience: 5+ yrs
Location: United States
Job type: Full-time

Required skills

vLLM
SGLang
Python
CUDA
Triton

About the role

5+ years professional systems engineering; deep hands-on experience with vLLM or SGLang; strong Python skills; understanding of LLM inference performance; experience with quantization, speculative decoding, or distributed serving; rigorous benchmarking and GPU profiling.

About RunPod

AI cloud computing platform providing on-demand GPUs and serverless compute to developers, researchers, and AI companies.

This page is fully interactive when JavaScript is enabled. Please enable JavaScript to apply or browse related roles.

Similar jobs

Sr. Technical Services Engineer (Remote US West)WEKAUnited States · 5+ yrs
Senior Detection Portfolio EngineerMicrosoftUnited States · 4+ yrs · $119k - $234k
AI Performance EngineerModularUnited States or Canada or United Kingdom · 5+ yrs · $180k - $270k
Content Innovation, Claims Editing (Multiple Levels)MachinifyUnited States · 7+ yrs · $135k - $165k
Content Innovation, Claims Editing – Specialty Pharmacy (Multiple Levels)MachinifyUnited States · 7+ yrs · $135k - $165k
Senior Engineer - Penetration Testing Finite StateUnited States · 7+ yrs
Senior Voice Operations EngineerLumistryUnited States · $120k - $130k
Sr. Clinical InformaticistCohere HealthUnited States · 4+ yrs · $85k - $100k
Senior Learning Performance Consultant, GTMiCIMSUnited States · 5+ yrs · $100k - $120k
Global Black Belt, Cowork & AgentsMicrosoftUnited States · 6+ yrs · $107k - $187k
Simulation Specialist, CONUSAechelon TechnologyUnited States · 5+ yrs
Senior Finance Change and Enablement AnalystDocusignCalifornia · 5+ yrs · $105k - $163k