Website:
callquestsolution.com
Job details:
Role Overview
We are seeking a Senior Data Engineer with strong expertise in modern data platforms, distributed systems, and cloud-based data engineering. The ideal candidate will take clear technical ownership in designing, building, and optimizing scalable data pipelines and platform architecture using Databricks and AWS technologies.
Key Responsibilitie
- sDesign, build, and optimize scalable data pipelines using Databricks, Apache Spark, and Python
- .Develop and maintain advanced SQL-based data transformations and analytics workflows
- .Architect and manage cloud-based data solutions on AWS
- .Implement orchestration workflows using Apache Airflow
- .Build and maintain CI/CD pipelines and DevOps practices using Jenkins, Docker, and Terraform
- .Develop and support real-time data processing using Kafka, Kinesis, or Spark Streaming
- .Ensure performance optimization, reliability, and scalability of data platforms
- .Collaborate with cross-functional and US-based teams to deliver high-quality solutions
.
Required Skil
- ls6–8 years of experience in Data Engineering, Distributed Systems, and Platform Architectur
- e.Strong hands-on expertise i
- n:Databric
- ksApache Spa
- rkPyth
- onAdvanced S
- QLCloud experience with AWS (S3, Lambda, EMR
- ).Experience with orchestration tools such as Apache Airflo
- w.CI/CD and containerization experience using Jenkins, Docker, Terrafor
- m.Experience with streaming technologies (Kafka, Kinesis, or Spark Streaming
).
Mandatory Certificati
- onsDatabricks Certified Data Engineer – Professio
- nalAWS Solutions Architect – Associate or Professional (Preferr
ed)
Preferred Tr
- aitsStrong ownership mindset and problem-solving ski
- lls.Experience working with globally distributed te
- ams.Excellent communication and collaboration abilit
ies.
Click on Apply to know more.