Recro
Website:
recro.io
Company:
https://www.linkedin.com/company/recro-io
Seniority: Mid-Senior level
Industries: Software Development
Job details:
We’re Hiring: AI Platform Engineer (AWS) | Bangalore (Hybrid)
We are looking for an experienced AI Platform Engineer (8+ years) to design, scale, and operate our production-grade AI Gateway and enterprise LLM infrastructure.
If you have moved beyond LLM prototypes and have hands-on experience building resilient, multi-model routing systems and agentic tool-use architectures at scale, we’d love to connect.
Key Details
- Role: AI Platform Engineer – AWS
- Experience: 8+ Years
- Location: Bangalore, India (Hybrid)
- Employment Type: Full-Time
- Core Tech Stack: AWS, Python, Kubernetes, Multi-LLM Routing, Model Context Protocol (MCP)
What You’ll Do
- AI Gateway Infrastructure: Design, deploy, and maintain an enterprise-grade AI Gateway serving multiple downstream internal and customer-facing applications.
- Multi-Provider Routing: Architect intelligent, high-availability model routing across OpenAI, Anthropic, Gemini, and proprietary/custom models with automated fallback strategies.
- Governance, Cost & Observability: Build quota management, intelligent rate limiting, centralized telemetry, and real-time cost/usage tracking for LLM traffic.
- Safety & Guardrails: Implement automated PII masking, safety guardrails, prompt evaluation pipelines, and version-controlled prompt management.
- Agent Infrastructure: Develop and maintain Model Context Protocol (MCP)-based tool-use patterns and infrastructure for downstream autonomous agent workflows.
- Production Operations: Take complete ownership of reliability, auto-scaling, incident management, and low-latency performance tuning for live production services.
What We’re Looking For
- 8+ years of core software and platform engineering experience.
- Expert Python Skills: Proven track record writing clean, modular, and maintainable production code.
- Cloud & Containers: Deep hands-on proficiency with AWS and Kubernetes for deploying and orchestrating resilient microservices.
- LLMOps in Production: Practical experience with multi-LLM routing, fallbacks, token cost optimization, and guardrail integration in live production (not just proof-of-concept projects).
- Agentic Ecosystems: Direct experience implementing Model Context Protocol (MCP) and structured tool-calling patterns.
Click on Apply to know more.