TekIT Software Solutions
Website:
tekitsolution.com
Job details:
Job Title: Data Engineer (GCP | BigQuery | Databricks)
Experience: 4–6 Years
Location: Bangalore
Job Summary
We are looking for a skilled Data Engineer with hands-on experience in Google Cloud Platform (GCP), Google BigQuery, Databricks, PySpark, and SQL to design, develop, and optimize scalable data pipelines. The ideal candidate should have expertise in ETL/ELT, cloud data warehousing, and building analytics-ready datasets while ensuring data quality, security, and performance.
Key Responsibilities
- Design, develop, and maintain scalable ETL/ELT pipelines using Databricks, Google BigQuery, and GCP.
- Build and optimize batch and streaming data pipelines using Apache Spark/PySpark.
- Develop and maintain BigQuery data models, partitioning, clustering, and query optimization.
- Build and optimize Databricks notebooks, Delta Lake tables, and Spark jobs.
- Design data warehouse solutions using Star/Snowflake schemas and dimensional modeling.
- Develop data transformation frameworks using Python, SQL, and PySpark.
- Orchestrate workflows using Airflow / Cloud Composer / Databricks Workflows.
- Ensure data quality through validation, reconciliation, monitoring, and error handling.
- Troubleshoot pipeline failures and optimize performance across development, test, and production environments.
- Implement data governance, IAM, security, and compliance best practices.
- Collaborate with business stakeholders, analysts, and cross-functional teams to deliver scalable data solutions.
Required Skills
- 4–6 years of experience as a Data Engineer / GCP Data Engineer / Big Data Engineer.
- Strong hands-on experience with Google BigQuery and Google Cloud Platform (GCP).
- Experience with Databricks, Apache Spark, PySpark, and Delta Lake.
- Strong proficiency in SQL (complex queries, CTEs, window functions, query tuning, partitioning, clustering).
- Experience with Python and/or Scala.
- Good understanding of ETL/ELT, Data Warehousing, Lakehouse Architecture, and Dimensional Modeling.
- Experience with Cloud Composer (Airflow), Dataflow, Dataproc, or Databricks Workflows.
- Knowledge of Cloud Storage (GCS), Pub/Sub, Cloud Functions, IAM, and Cloud SQL.
- Experience with Git, CI/CD, Docker, Kubernetes, and Agile methodologies.
- Strong analytical, problem-solving, and communication skills.
Click on Apply to know more.