Lead Data Engineer
r3 Consultant
- Location
- Jaipur, Rajasthan, India
- Job type
- Full-time
Required skills
- Python
- Agile
- Apache
- Apache Spark
- big data technologies
- communication skills
- cross-functional
- CSV
- data engineer
- data modeling
- Databricks
- ETL
- JSON
- machine learning
- metadata management
- MySQL
- Parquet
- Postgres
- Spark
- SQL
About the role
r3 Consultant
Website:
r3consultant.com
Job details:
Job Title :Lead Data Engineer
Location- Remote
Work Exp- 8 yrs
Budget- 40-50 LPA
Shift timings- 10am-7pm IST
Work days- 5 days
What You’ll Be Doing:
- Own the architecture and roadmap for scalable, secure, and high-quality data pipelines and platforms.
- Lead and mentor a team of data engineers while establishing engineering best practices, coding standards, and governance models.
- Design and implement high-performance ETL/ELT pipelines using modern Big Data technologies for diverse internal and external data sources.
- Drive modernization initiatives including re-architecting legacy systems to support next-generation data products, ML workloads, and analytics use cases.
- Partner with Product, Engineering, and Business teams to translate requirements into robust technical solutions that align with organizational priorities.
- Champion data quality, monitoring, metadata management, and observability across the ecosystem.
- Lead initiatives to improve cost efficiency, data delivery SLAs, automation, and infrastructure scalability.
- Provide technical leadership on data modeling, orchestration, CI/CD for data workflows, and cloud-based architecture improvements.
Qualifications:
- Bachelor's degree in Engineering, Computer Science, or relevant field.
- 8+ years of relevant and recent experience in a Data Engineer role.
- 5+ years recent experience with Apache Spark and solid understanding of the fundamentals.
- Deep understanding of Big Data concepts and distributed systems.
- Demonstrated ability to design, review, and optimize scalable data architectures across ingestion.
- Strong coding skills with Scala, Python and the ability to quickly switch between them with ease.
- Advanced working SQL knowledge and experience working with a variety of relational databases such as Postgres and/or MySQL.
- Cloud Experience with DataBricks.
- Strong understanding of Delta Lake architecture and working with Parquet, JSON, CSV, and similar formats.
- Experience establishing and enforcing data engineering best practices, including CI/CD for data, orchestration and automation, and metadata management.
- Comfortable working in an Agile environment
- Machine Learning knowledge is a plus.
- Demonstrated ability to operate independently, take ownership of deliverables, and lead technical decisions.
- Excellent written and verbal communication skills in English.
- Experience supporting and working with cross-functional teams in a dynamic
environment.
Click on Apply to know more.
This page is fully interactive when JavaScript is enabled. Please enable JavaScript to apply or browse related roles.