AI Inference Platform Engineer
DRW
- Salary
- $200k - $250k
- Location
- Chicago, Illinois, United States
- Job type
- Full-time
Required skills
- TensorRT-LLM
- vLLM
- SGLang
- CUDA
- NVIDIA
- Nsight
- DCGM
- OpenTelemetry
- Prometheus
- Grafana
- Linux
About the role
Hands-on experience serving LLMs on NVIDIA GPUs, expertise in inference runtimes like TensorRT-LLM or vLLM, knowledge of inference optimization techniques, KV cache architecture, distributed inference, multi-tenant GPU scheduling, and proficiency with GPU performance tooling.
About DRW
Global proprietary trading firm investing across diverse asset classes.
This page is fully interactive when JavaScript is enabled. Please enable JavaScript to apply or browse related roles.
