Website:
protalentcrafter.com
Job details:
Job Title: Senior AI Software Engineer
Location: India (Fully Remote) will have to work according to US Time
Term: long term
Responsibilities
• Design, build, and maintain Python (FastAPI) microservices across a large monorepo — spanning LLM communication, agentic workflow execution, API gateway routing, claims processing, and AI tool orchestration
• Develop and extend agentic AI pipelines — including document ingestion, retrieval-augmented generation (RAG), and multi-step agent workflows with tool use and planning
• Integrate with Large Language Models (OpenAI, Azure OpenAI) and build abstraction layers for provider-agnostic LLM access
• Design and manage Elasticsearch indices as a primary datastore — including index mapping, schema generation, and search query optimization
• Use Redis for caching, distributed session state, and service coordination
• Build and consume MCP (Model Context Protocol) servers and tools — a cutting-edge pattern for exposing structured capabilities to AI agents
• Contribute to shared internal libraries — logging, tracing, data access, execution state — treated as first-class APIs that other services depend on
• Author Pydantic v2 data models, including schema-driven code generation from centralized JSON schemas
• Write fully async Python for high-throughput inter-service communication and database access
• Implement distributed tracing (OpenTelemetry) and structured logging for end-to-end observability across services
• Work with document processing and computer vision pipelines — PDF extraction, OCR, and image processing
• Participate actively in code reviews, architecture discussions, and sprint planning — your written feedback is expected to be clear, thorough, and constructive
• Write pytest test suites covering unit, integration, and async scenarios
Must Have Skills
• 8+ years of professional software engineering experience, with at least 2 focused on AI/ML systems or LLM-integrated backend services
• Expert-level Python 3.12+ — async/await, type annotations, Pydantic v2
• Production experience building FastAPI or equivalent async Python web services
• Hands-on experience with LLM APIs (OpenAI, Azure OpenAI, or equivalent) in a backend production context
• Experience with an AI orchestration framework — we use Haystack AI, but strong candidates coming from LangChain or LlamaIndex are equally welcome; we care about the concepts, not the brand
• Working knowledge of Elasticsearch — index design, mapping strategies, search and aggregation queries
• Familiarity with Redis for caching or distributed coordination
• Solid understanding of RESTful API design and async inter-service communication patterns
• Experience working in a microservices monorepo with shared libraries and cross-service dependencies
• Proficiency with Docker, containerized local development, and cloud-deployed services
• Strong familiarity with Git, pull request workflows, and CI/CD pipelines
• Fluent English communication — written and verbal. This role requires daily written collaboration: design documents, code review commentary, technical proposals, and cross-functional discussions with both technical and non-technical stakeholders. Candidates must be able to communicate complex technical ideas clearly and professionally in English.
Preffered Skills
• Experience with MCP (Model Context Protocol) — building servers, registering and consuming tools
• Experience with OpenTelemetry — spans, context propagation, distributed tracing
• Familiarity with async database drivers and async ORM patterns (SQLAlchemy async, asyncpg, or similar)
• Knowledge of Prometheus metrics and service-level observability design
• Experience with document processing and OCR pipelines (PDF parsing, image extraction, optical character recognition)
• Comfort working with enforced code quality toolchains — linting, static type checking, and automated pre-commit checks
• Familiarity with Poetry for Python dependency and virtual environment management
Click on Apply to know more.