Questhiring
Website:
questhiring.com
Company:
https://www.linkedin.com/company/questhiring
Seniority: Mid-Senior level
Industries: IT Services and IT Consulting
Job details:
Data Engineering Manager
Location: Gurugram
Work Mode: Hybrid
Experience: 12–16 Years
Function: Data Engineering / Data Platforms
About the Role
We are looking for an experienced Data Engineering Manager to lead data engineering initiatives and drive the design, development, and delivery of scalable data platforms and pipelines.
The ideal candidate should come from a strong Data Engineering background with hands-on expertise in Google Cloud Platform (GCP), PySpark, and Apache Airflow. The candidate will be responsible for technical leadership, engineering best practices, team management, and delivering reliable, high-performance data solutions.
Key Responsibilities
- Lead and mentor a team of data engineers and provide strong technical direction.
- Design and architect scalable, secure, and high-performance data engineering solutions on GCP.
- Drive development of robust data pipelines using PySpark and Apache Airflow.
- Own end-to-end data engineering projects, from requirement analysis to production deployment.
- Define data architecture, engineering standards, coding practices, and best practices.
- Work closely with Product, Analytics, Data Science, and other technology teams.
- Optimize data pipelines for performance, scalability, reliability, and cost.
- Establish monitoring, logging, data quality, and operational processes for production pipelines.
- Review technical designs and code while ensuring engineering quality.
- Troubleshoot complex data pipeline and platform issues.
- Manage project timelines, technical dependencies, risks, and delivery expectations.
- Stay updated with emerging technologies and trends in cloud data engineering.
Mandatory Skills
- 12–16 years of overall IT experience, with strong experience specifically in Data Engineering.
- GCP – Mandatory
- Strong hands-on experience with PySpark / Apache Spark.
- Strong hands-on experience with Apache Airflow.
- Strong understanding of data engineering concepts, ETL/ELT pipelines, and distributed data processing.
- Experience designing and implementing scalable data platforms on cloud.
- Strong programming/scripting experience, preferably Python.
- Experience with data warehouses, data lakes, and modern cloud data architectures.
- Strong understanding of data modelling, data integration, and pipeline orchestration.
- Proven experience leading technical teams and delivering enterprise-scale data engineering projects.
- Strong communication, stakeholder management, and problem-solving skills.
Good to Have
- Experience with BigQuery, Cloud Storage, Dataflow, Dataproc, Pub/Sub or other GCP data services.
- Experience with CI/CD and DevOps practices for data engineering.
- Knowledge of Kubernetes, Docker, Terraform, or Infrastructure as Code.
- Experience implementing data quality and governance frameworks.
- Exposure to real-time/streaming data pipelines.
- Experience working in Agile/Scrum environments.
Ideal Candidate Profile
We are looking for someone who is technically hands-on as well as an effective people/technical leader. The candidate should have a strong foundation in Data Engineering and be capable of taking ownership of large-scale data platforms while mentoring engineers and working with senior stakeholders.
Key Keywords: GCP | PySpark | Apache Spark | Airflow | Python | BigQuery | Data Engineering | ETL/ELT | Data Pipelines | Cloud Data Platform | Data Architecture | Team Leadership
Work Location & Culture
📍 Gurugram
🏢 Hybrid Work Culture
💼 Experience: 12–16 Years
Candidates with strong hands-on GCP + PySpark + Airflow experience and a solid Data Engineering background are preferred.
Click on Apply to know more.
