Antal International
Website:
antal.com
Company:
https://www.linkedin.com/company/antal-international
Seniority: Associate
Industries: Staffing and Recruiting
Job details:
Are you passionate about building robust, scalable infrastructure for cutting-edge Generative AI? We’re looking for an AIOps Engineer to join our AI Foundation team in Bangalore to own and scale our AI/LLM production platform!
Location: Bangalore
Mode: Work from office
Responsibilities:
- LLM Gateway & Orchestration: Own multi-model serving layers and orchestration across providers like AWS Bedrock.
- AI CI/CD: Build pipelines for seamless versioning, automated rollouts, and rollbacks of models, prompts, and AI microservices.
- Observability & Performance: Drive end-to-end tracing, logging, and alerting (OpenTelemetry, Grafana, Prometheus) while optimizing transaction costs and latency.
- Compliance & Security: Ensure secure handling of PHI/PII data in a production AI ecosystem.
Requirements:
- Experience: 2+ years overall in DevOps/MLOps/Software Engineering, with 1–2 years hands-on with production LLM/AI systems.
- Tech Stack: Python, AWS (Bedrock, IAM, Compute), Docker/Kubernetes, GitHub Actions / GitLab CI.
Click on Apply to know more.