Website:
bodhan.ai
Job details:
About Bodhan AI
At Bodhan AI, we are reimagining how India learns in the age of AI.
Incubated at IIT Madras and supported by the Ministry of Education, Bodhan AI is developing the Bharat EduAI Stack; a sovereign Digital Public Infrastructure designed to make AI-powered learning inclusive, multilingual, and accessible to every learner across the country.
About the Role: AI Infrastructure Engineer
You will be at the heart of deploying and scaling AI systems that power millions of learners.
Key responsibilities will be:
- Design, deploy, and manage AI infrastructure for running ASR, TTS, LLM, and other AI workloads in production (TensorRT,vLLM,NVCF)
- Select and provision appropriate compute resources including GPUs, TPUs, CPUs, and accelerators based on workload requirements
- Optimize resource utilization to minimize idle capacity and control infrastructure costs
- Design and manage intelligent routing of inference tasks (ASR, TTS, LLM, RAG) to appropriate compute instances for low latency and high throughput
- Implement autoscaling strategies for AI services based on traffic patterns and system load
- Build and maintain CI/CD pipelines for backend services, AI models, and infrastructure components
- Ensure high availability, fault tolerance, and fast recovery for all production systems
- Implement monitoring, logging, and alerting for infrastructure health, performance, latency, and cost (cost tracking is very important)
- Manage secrets, environment configurations, and secure access to infrastructure resources
- Collaborate closely with system architects, backend engineers, and AI engineers to align infrastructure with application and model requirements
- Continuously evaluate and adopt new infrastructure tools, frameworks, and deployment strategies to improve performance and efficiency.
We are looking for
- B Tech in computer science or any related engineering field
- 3-4 years of hands-on experience in infrastructure and deployment
- Strong understanding of AI/ML production environments
- Takes ownership and delivers end-to-end
- Communicates clearly and collaborates effectively
- Can mentor and guide new team members
- Manages time and priorities in a fast-moving environment
Why Join Us?
- Work on nation-scale AI infrastructure
- Build for real impact in education and equity
- Collaborate with top minds across AI, policy, and technology
- Be part of India’s sovereign AI movement
Interested can share their resumes to barry@bodhan.ai
Click on Apply to know more.