Hitya Global
Website:
hityaglobal.in
Job details:
What You'll Own
AI Infrastructure Architecture :
- Design and implement asynchronous multi-agent orchestration
- Own end-to-end latency from user message to AI response
- Build resilient inference pipelines that gracefully degrade under load
- Implement intelligent request routing and load balancing for AI workloads
- Migrate critical AI conversation flow from monolith to dedicated services
- Implement WebSocket/streaming infrastructure for real-time chat
- Design circuit breakers and fallback strategies for AI model failures
- Build comprehensive observability for AI system performance
- Optimize credit data retrieval and caching strategies
Technical Requirements
Must-Have Experience :
- 3 to 5 years building production systems handling >10k concurrent users
- Proven experience with async/event-driven architectures (not just REST APIs)
- Hands-on experience scaling ML/AI inference in production
- Deep understanding of caching strategies (Redis, in-memory, CDN)
- Experience with message queues and real-time communication protocols
AI-Specific Expertise
- Built systems integrating multiple LLM/AI models in production
- Experience with AI model serving frameworks (TensorFlow Serving, Triton, etc.)
- Understanding of AI inference optimization (batching, caching, model quantization)
- Knowledge of conversation state management and context handling
- Has debugged production issues under high AI inference load
Growth Path
- Direct impact on customer subscription retention through performance
- Exposure to cutting-edge AI infrastructure challenges
- Ownership of technical decisions affecting revenue-generating conversations
- Path to leading AI platform team as you scale
Interview Process
- Technical Assessment : Intro + AI/ML focused technical discussion (60 minutes)
- System Design : Architecture and scaling conversations (60 minutes)
- Final Round : Cultural alignment and team interaction
Next Steps
Ready to help millions of Indians build better financial futures through AI? We'd love to hear from you.
Apply To
- Your resume highlighting relevant AI/ML experience
- Brief note on what excites you about this opportunity
- Links to relevant projects or GitHub repositories (optional)
(ref:hirist.tech)
Click on Apply to know more.