- Location
- India
- Job type
- Full-time
Required skills
- Python
- Airflow
- AWS
- CI
- CloudFormation
- data architecture
- data engineer
- Databricks
- end-to-end
- ETL
- Jenkins
- Kafka
- KPI
- Lambda
- Snowflake
- Spark
- SQL
- Terraform
- Unity
About the role
Mogi I/O : OTT/Podcast/Short Video Apps for you
Website:
mogiio.com
Job details:
Location: Bangalore, India
Salary Range: INR 30,00,000 – 34,00,000 per annum
Experience Required: 10–12 Years
Role Overview
are seeking a Lead Data Engineer to drive the enterprise data engineering strategy for a unified analytics platform across Digital, Stores, and Marketplace channels.
This role will lead the end-to-end architecture roadmap, including the complete migration from Snowflake to a Databricks/Spark Lakehouse ecosystem on AWS, ensuring enterprise-wide KPI consistency (≥95%).
You will function as both a hands-on technical leader and strategic architect, guiding platform modernization and governance initiatives at scale.We
Key Responsibilities
- Define and implement the target-state data architecture using Databricks, Spark, and AWS services.
- Lead Snowflake divestiture and ensure seamless business continuity.
- Design scalable batch and real-time data pipelines using Python, Spark, SQL, Kafka, and Kinesis.
- Build and optimize ETL/ELT workflows on AWS (S3, Lambda, EMR, Databricks).
- Establish orchestration standards (Airflow), CI/CD processes (Git, Jenkins), and Infrastructure as Code frameworks (Terraform/CloudFormation).
- Implement data governance, lineage, and metric management frameworks using Unity Catalog.
- Ensure monitoring, SLA/SLO adherence, and operational excellence across platforms.
- Mentor and lead engineering teams.
Required Qualifications
- 10+ years of experience in data engineering and distributed systems with strong architectural ownership.
- Deep AWS expertise with hands-on Databricks experience in large-scale production environments.
- Advanced proficiency in Python and SQL.
- Proven experience modernizing legacy systems and migrating to Databricks/Spark Lakehouse architectures.
- Strong background in data governance, lineage, and enterprise KPI management.
Certifications (Mandatory)
- Databricks Certified Data Engineer – Professional
- AWS Solutions Architect – Associate or Professional (Preferred)
Click on Apply to know more.
This page is fully interactive when JavaScript is enabled. Please enable JavaScript to apply or browse related roles.