Talentmatics
Website:
talent-matics.com
Job details:
We are hiring a Senior Databricks Data Engineer with strong expertise in Databricks, PySpark, and Azure Data Engineering to build scalable, high-performance, and cloud-native data solutions. The ideal candidate should have hands-on experience in ETL pipeline development and modern data lake architectures.
Location: Pune / Mumbai
Experience: 5–8 Years
Preferred Notice Period: Immediate Joiners to 30 Days
Mandatory Certifications :
Candidates should hold at least one of the following certifications :
- Microsoft Certified: Azure Data Engineer Associate
- Databricks Certified Associate Developer for Apache Spark
Key Responsibilities :
- Design, develop, and manage scalable data pipelines using Databricks and PySpark.
- Develop and optimize ETL workflows for large-scale data processing environments.
- Implement strong data quality frameworks and maintain data consistency across platforms.
- Integrate data from various sources including APIs, databases, and cloud-based data lakes.
- Optimize Spark and PySpark workloads for enhanced performance and resource utilization.
- Work extensively with Delta Lake for reliable, scalable, and version-controlled data storage.
- Migrate and optimize traditional stored procedures into Databricks-based solutions.
- Manage schema evolution and contribute to scalable data architecture design practices.
Mandatory Skills :
- Strong hands-on expertise in Databricks and PySpark.
- Experience working with Azure Databricks and modern cloud-based data engineering solutions.
- Proven experience in ETL pipeline development and Spark performance optimization.
- Strong understanding of Delta Lake and distributed data processing concepts.
- Experience integrating data from APIs, databases, and cloud storage platforms.
- Good knowledge of big data technologies and scalable data architectures.
Click on Apply to know more.