Website:
ushakkaal.com
Job details:
Consulting Engineer – AI Inference Infrastructure (Remote)
Commitment: 20 hrs/week (Flexible)
Duration: 6–12 weeks (Renewable)
Location: Remote (Weekly overlap with US Pacific time required)
About PrimaLabs
PrimaLabs is building a workload-specific AI inference serving platform that maximizes real-world accelerator performance through closed-loop autotuning.
We're looking for experts in one or two of the following areas:
- Disaggregated Inference
- KV Cache Systems (LMCache, HiCache, etc.)
- Speculative Decoding
- Inference Routing & Gateway
- Serving Stack Engineering (vLLM, SGLang, NVIDIA Dynamo)
- Throughput & Latency Optimization
Requirements
- 5+ years in Systems, HPC, Distributed Systems, or ML Infrastructure
- Hands-on experience with AI inference serving
- Strong Python; working knowledge of C++/CUDA
- Experience with multi-node GPU clusters and containerized deployments
- Benchmark-driven, performance optimization mindset
- Ability to work independently with weekly checkpoints
Nice to Have
- Quantized inference (FP8/FP4)
- KV transfer/cache-tiering projects
- Open-source contributions (vLLM, SGLang, etc.)
- Bayesian optimization or autotuning experience
What You'll Get
- Access to production-grade multi-GPU clusters
- Real-world traffic and benchmarking infrastructure
- Direct collaboration with the founding team
- Fast decision-making and high-impact engineering work
Click on Apply to know more.
