Website:
rlogicssolutions.com
Job details:
Premium Recruitment Pack
Senior AI Data Platform Engineer / AI Data Architect
AI Factory – Specialist AI Platform Engineering Team
Location: Chennai, India (Offshore) | Opportunity to Relocate to the UK after 12 Months (subject to business needs, performance and immigration requirements).
About the AI Factory
We are building a next-generation Enterprise AI Factory focused on sovereign, secure and open-source AI platforms. Our engineering culture combines semantic intelligence, metadata-driven governance, Agentic AI, knowledge engineering and enterprise architecture to deliver trusted AI for regulated industries.
The Opportunity
Based in Chennai, you will join a niche specialist AI Platform Engineering team working directly with UK architects on strategic platform development. This is a long-term career opportunity with structured mentoring, ownership of key platform components and potential relocation to the UK after approximately 12 months.
Role Summary
Design and build the trusted data foundation for Agentic AI, RAG, GraphRAG, metadata governance, AI evaluation, model quality and enterprise analytics. This is a platform engineering role rather than a traditional ETL position.
Key Responsibilities
- Design and build the data lakehouse foundation (Apache Iceberg), refining raw data through layered, medallion-style zones into curated gold datasets.
- Write custom ingestion connectors and pipelines for many heterogeneous sources — batch, streaming and change-data-capture across APIs, files, databases and unstructured data, using Python and Go for high-throughput services (Airbyte, Kafka, Debezium).
- Implement metadata-first governance, lineage, data quality and privacy/PII controls for regulated industries (OpenMetadata, Great Expectations, Presidio).
- Build the semantic and knowledge layer — vector, graph and knowledge stores with RAG/GraphRAG retrieval pipelines (chunking, embeddings, re-ranking).
- Engineer features, transformations and training/evaluation datasets, and maintain a feature store, to produce analytics- and AI-ready data products (Feast).
- Expose governed, agent-ready gold-layer data for Agentic AI and MCP-based services to consume reliably.
- Research emerging open-source technologies and collaborate closely with AI Architects, ML and Platform Engineers.
About You
- Strong software engineering background with production experience in Python and SQL.
- Experience building data platforms or pipelines at scale (Spark, Kafka, containerised workloads).
- Experience designing layered data lakes or lakehouses (medallion / bronze–silver–gold architectures).
- Familiarity with metadata, governance or data-quality tooling such as OpenMetadata or Great Expectations.
- Comfortable building bespoke connectors and integrations for varied source systems, protocols and data formats.
- Exposure to AI/ML data workflows — RAG, vector or graph databases, or model evaluation (desirable).
- Comfortable in an open-source-first, cloud-native environment (Docker, Kubernetes, Linux).
- Working knowledge of Go is a plus — particularly for high-throughput ingestion connectors, streaming services and MCP/Kubernetes-native tooling (desirable).
- A collaborative, continuous-learning mindset and clear communication with distributed, international teams.
Technology Stack
Python, SQL, Go, Spark, Docker, Kubernetes, Linux, PostgreSQL, MongoDB, Redis, ClickHouse, OpenMetadata, Airbyte, Kafka, Debezium, Qdrant, Chroma, FalkorDB, Neo4j, LangChain, LangGraph, MCP, MLflow, Kubeflow, Great Expectations, Evidently AI, Presidio, Feast and Apache Iceberg.
Engineering Principles
- Metadata-first
- Semantic intelligence
- Open-source first
- API-first
- Secure by design
- Automation
- Scalability
- Observability
- Continuous learning
30/60/90 Day Expectations
- 30 Days: Learn the platform and contribute to core data engineering.
- 60 Days: Deliver metadata pipelines and AI data quality capabilities.
- 90 Days: Lead platform enhancements, optimise semantic data services and contribute to architecture decisions.
Why Join Us
Influence a next-generation AI platform, work on cutting-edge open-source technologies, collaborate internationally, and build enterprise AI capabilities with genuine opportunities for career progression and international mobility.
Click on Apply to know more.