Egen
Website:
egen.ai
Job details:
Job Description :
We are looking for a Lead ML Engineer to take full ownership of the customer next-generation search platform. You will bridge advanced information retrieval (IR) modeling with high-throughput production systems — building, tuning, and scaling hybrid search pipelines while owning the evaluation harness, performance benchmarks, and master data integrations that guarantee extreme precision and sub-second latency at scale.
This is a high-impact, end-to-end engineering role. You will shape the architecture of a system that directly affects the experience of millions of customers, while mentoring talented engineers and partnering closely with product and data stakeholders.
WHAT YOU'LL DO
Search Core & Information Retrieval
- Design, build, and tune a hybrid search engine combining Vector Search (semantic) and Lexical Search (BM25/keyword) to deliver best-in-class relevance.
- Implement advanced ranking and blending strategies including BGE rerankers and Reciprocal Rank Fusion (RRF).
- Own end-to-end search accuracy and relevance metrics (NDCG, MRR, Recall) and drive measurable, data-backed improvements over time.
Evaluation & Quality Assurance
- Build and maintain an automated accuracy evaluation harness for continuous, regression-proof pipeline testing.
- Establish quality benchmarks and champion a metrics-first engineering culture across the team.
Performance, Scalability & Infrastructure
- Conduct systematic load testing (Locust, k6) and stress-test retrieval pipelines to surface and eliminate bottlenecks.
- Architect and optimize systems to guarantee a strict SLA of P95 latency < 500ms under peak production load.
- Partner with DevOps/MLOps to design scalable, resilient deployment patterns for search and ranking models.
Data Engineering & Governance
- Manage ingestion pipelines for Master Data Management (MDM) feed integration, ensuring clean and timely data synchronisation.
- Govern schema and operational configurations within the Firestore spec_registry.
- Collaborate with data governance teams to uphold data quality standards across all search indexes.
Leadership & Collaboration
- Mentor junior and mid-level engineers through code reviews, pairing, and technical guidance.
- Lead cross-functional AI/ML project teams, translating business requirements into clear technical roadmaps.
- Communicate complex architectural decisions clearly to both technical peers and non-technical stakeholders.
WHAT WE'RE LOOKING FOR
Core Technical Skills
- Deep hands-on experience with vector databases (Pinecone, Milvus, Qdrant) and search engines (Elasticsearch, OpenSearch)Proven experience implementing reranking models (BGE, Cohere) and fusion techniques (RRF) in production. Expertise in load testing with Locust or k6 and diagnosing distributed system bottlenecks. Experience integrating enterprise MDM feeds and managing NoSQL stores, specifically Google Cloud Firestore.
- Strong background applying ML techniques to search relevance, ranking, and personalisation. Hands-on experience with LLMs or GenAI for search retrieval and knowledge synthesis.
- Solid grounding in statistical evaluation for search quality and system reliability.
Must-Have Qualifications
- 10+ years of professional experience in Machine Learning and AI engineering.
- Google Cloud Professional Machine Learning Engineer or TensorFlow Developer Certification.
- Hands-on experience with MLOps, CI/CD pipelines, and orchestration tools (Kubeflow, Airflow, Dagster).
- Familiarity with model serving and monitoring frameworks ( Vertex AI, Azure ML etc)
- Demonstrated track record of mentoring engineers and leading cross-functional AI/ML projects.
Nice to Have
- Experience in Computer Vision or Recommender Systems.
- Familiarity with knowledge graph construction or entity resolution pipelines.
- Prior exposure to e-commerce or supply chain search use cases.
EDUCATION
- Minimum: B.Tech. / B.E. in Computer Science, Information Technology, or a related field.
- Preferred: Master’s degree (M.S. / M.Tech.) in Machine Learning, Data Science, or Artificial Intelligence.
Click on Apply to know more.