TekIT Software Solutions
Website:
tekitsolution.com
Job details:
Position Title:
Data Engineering Manager
Experience Required:
10–12 Years
Job Summary:
We are seeking an experienced Data Engineering Manager to lead the design, development, and optimization of scalable data platforms and modern data pipelines across cloud and on-premise environments. This role will be responsible for managing data engineering initiatives, ensuring robust data architecture, high-performance data pipelines, and reliable data integration across business domains while supporting enterprise analytics and modernization programs.
Key Responsibilities:
- Lead the design, development, and maintenance of scalable end-to-end data pipelines and ETL/ELT workflows.
- Architect and optimize modern data platforms across cloud and hybrid environments.
- Manage ingestion, transformation, and orchestration of structured/unstructured data from diverse sources.
- Optimize cloud-based data infrastructure for performance, scalability, reliability, and cost efficiency.
- Collaborate with Data Architects, Analysts, Product Teams, and Business Stakeholders for seamless data delivery.
- Establish and enforce data quality, governance, lineage, and security best practices.
- Drive CI/CD implementation and DevOps adoption within data engineering workflows.
- Monitor, troubleshoot, and resolve production data pipeline/platform issues.
- Mentor and lead a team of data engineers, promoting engineering excellence and best practices.
- Participate in architecture reviews, technology evaluations, and modernization initiatives.
- Ensure compliance with enterprise data governance and security standards.
Required Skills & Qualifications:
- 10–12 years of experience in Data Engineering / Data Platform Engineering.
- Strong expertise in Python and Advanced SQL.
- Hands-on experience with ETL/ELT and data processing tools/frameworks such as:
- Apache Spark
- Google Dataflow
- AWS Glue
- Azure Data Factory (ADF)
- Strong experience with one or more cloud platforms:
- GCP: BigQuery, Dataflow, Composer, Pub/Sub
- AWS: Redshift, Glue, EMR, S3
- Azure: Synapse, Data Factory, Databricks
- Expertise in distributed data processing and orchestration frameworks:
- Apache Spark
- Apache Airflow / Composer
- Experience with Data Warehousing / Data Lakes / Lakehouse Architecture.
- Strong knowledge of streaming technologies:
- Kafka
- Google Pub/Sub
- Solid understanding of DevOps / CI-CD tools:
- Git
- Jenkins / GitHub Actions / Azure DevOps
- Strong experience in data modeling and schema design.
- Experience in performance tuning and pipeline optimization.
- Excellent stakeholder management and team leadership skills.
Preferred Qualifications:
- Experience managing/mentoring engineering teams.
- Exposure to modern Lakehouse/Data Mesh architecture.
- Experience in Agile/Scrum delivery models.
- Cloud certifications (AWS/GCP/Azure) preferred.
Good to Have:
- Experience with Infrastructure as Code (Terraform, CloudFormation).
- Knowledge of containerization/orchestration (Docker, Kubernetes).
- Exposure to dbt / Snowflake / Databricks.
Click on Apply to know more.