TekIT Software Solutions
Website:
tekitsolution.com
Job details:
Data Engineer – Data Platform
Location: Bangalore
Experience: 4+ Years
Role: Permanent
Role Overview
We are looking for a hands-on Data Engineer to build and optimize scalable cloud data platforms and pipelines using Databricks and GCP BigQuery.
Key Responsibilities
- Develop and maintain scalable ETL/ELT data pipelines using Python, SQL and PySpark.
- Work with Databricks, Apache Spark and GCP BigQuery for data processing and analytics.
- Build data solutions using Lakehouse / Medallion Architecture and Delta Lake.
- Develop batch and real-time data ingestion pipelines using Airflow, Kafka and CDC.
- Implement data quality, validation, monitoring and error-handling processes.
- Follow engineering best practices including Git, CI/CD, testing and code reviews.
- Optimize data pipelines for performance, scalability and cost.
- Collaborate with architects, analysts and business stakeholders to understand requirements and deliver data solutions.
Must-Have Skills
- 4+ years of hands-on Data Engineering experience.
- Strong Python, SQL and PySpark/Spark skills.
- Hands-on experience with Databricks and BigQuery.
- Good understanding of ETL/ELT, data pipelines and Lakehouse architecture.
- Experience with Delta Lake / Medallion Architecture.
- Exposure to Airflow, Kafka and/or CDC.
- Knowledge of cloud platforms (GCP/AWS/Azure).
- Experience with Git, CI/CD, testing and data quality.
- Strong problem-solving and communication skills.
Good to Have
- Apache Iceberg / BigLake.
- dbt.
- Unity Catalog.
- Infrastructure as Code (IaC).
- Cloud security, IAM and cost optimization.
Click on Apply to know more.
