TRUGlobal
Website:
truglobal.com
Job details:
Head of AI Infrastructure Engineering, Cloud & Infrastructure Services (CIS)
TRUGlobal | Bengaluru | Full-time
TRUGlobal is building AI-led infrastructure solutions for enterprise clients, and we are hiring a hands-on engineering leader to build them, take them to production and grow the team. You will report to the Chief Delivery Officer, Infrastructure & Cloud Services.
What you will do
- Design, build and take AI infrastructure solutions from concept to production for enterprise clients (AIOps, private LLM and RAG platforms, GPU infrastructure).
- Run model serving, vector stores, orchestration, capacity and cost on cloud and on-premises GPUs.
- Set up LLMOps and MLOps: CI/CD for models and agents, evaluation, monitoring and guardrails.
- Design autonomous actions with clear guardrails, approvals and rollback, and integrate with ITSM, monitoring and security stacks.
- Set architecture, coding, testing and release standards, with AI governance aligned to SOC 2 and ISO 27001.
- Work with the Practice and Presales teams to turn each build into a deployable, supportable solution (packaging, sizing, runbooks, demo environments), and hand over to Delivery.
- Hire and lead the AI infrastructure engineering team, and build AI and automation skills across CIS.
What we are looking for
- 18+ years in infrastructure or platform engineering, including 5+ years leading teams that built AI, ML or intelligent-automation solutions.
- At least two AI infrastructure solutions you built from design to production, used by enterprise clients.
- Hands-on production experience with model serving (vLLM, Triton or similar), RAG, agents or MLOps, on cloud and on-prem GPU.
- Strong infrastructure background: cloud, compute, storage, network and observability.
- Experience working with practice, presales and delivery to turn an engineering build into a sellable solution.
- You still write and review code.
Technical skills we value
vLLM / Triton / TensorRT, NVIDIA GPU stack, Kubernetes for AI workloads (Kueue, Run:ai or similar), vector databases, agent frameworks, evaluation pipelines, Terraform, Ansible, ServiceNow, Python, AWS / Azure / GCP / OCI, SIEM/SOC and identity.
Nice to have: Kubernetes (CKA/CKAD), hyperscaler professional or AI specialty certification, NVIDIA certification.
Location and working pattern: TRUGlobal office in Bengaluru, with overlap with US hours as needed and periodic US travel.
Click on Apply to know more.