Marktine Technology Solutions Pvt Ltd
Website:
marktine.com
Job details:
Lead GCP Data Engineer (AWS to GCP Migration Preferred)
Experience: 7 to 15 Years
Job Location: Remote, India
Work Mode: Remote (Quarterly Once travel required to Madurai)
Shift Timing: 2:00 PM 11:30 PM IST (Flexibility to extend working hours based on business requirements)
Required Technical Skills – Cloud Data Engineering (GCP)
Strong hands-on experience in Google Cloud Platform (GCP), including BigQuery, Pub/Sub, Dataflow (Apache Beam), Cloud Composer (Airflow), and Cloud Storage.
Proficient in Python (Pandas, PyArrow, FastAvro) and Advanced SQL with query optimization skills.
Experience with Spark/PySpark for large-scale data processing (preferred).
Knowledge of ETL/ELT pipeline development, data modeling, schema design, partitioning, clustering, and workflow orchestration.
Hands-on experience in Data Quality, Data Governance, Dataplex, data lineage, schema validation, and deduplication.
Experience with CI/CD pipelines (Azure DevOps), Terraform (Infrastructure as Code), and Docker for deployment automation.
Strong understanding of Cloud Monitoring, Logging (Stackdriver/Cloud Logging), pipeline performance optimization, troubleshooting, and production support.
Click on Apply to know more.
