York Digital Consulting Inc.
Website:
yorkdigital.ca
Job details:
Senior GCP Developer
Location: India, Remote
Time Zone: Must be able to work with significant overlap with EST business hours up to 2PM.
Start Date: ASAP
Notice Period: Immediate joiners or candidates available to join within 15 days.
Position Overview
We are looking for highly experienced Senior GCP Developers to join a long-term technology initiative supporting cloud-based data engineering and application development. The ideal candidates will have strong hands-on experience developing and implementing data solutions on Google Cloud Platform, with particular expertise in BigQuery, advanced SQL, Python, and GCP native services.
Key Responsibilities
- Design, develop, and maintain scalable data solutions using Google Cloud Platform.
- Develop complex SQL queries and data transformations using Google BigQuery.
- Build and maintain data processing pipelines using GCP native services, including Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer.
- Develop data engineering and automation solutions using Python.
- Design and implement batch and streaming data processing workflows.
- Develop and maintain workflow orchestration using Apache Airflow and/or Cloud Composer.
- Work with Pub/Sub and event driven architectures to support real time and asynchronous data processing.
- Implement data ingestion, transformation, validation, and processing pipelines across GCP services.
- Optimize BigQuery queries and data processing workflows for performance, scalability, and efficiency.
- Troubleshoot production issues and identify opportunities to improve reliability and performance.
- Collaborate with technical teams and stakeholders to understand requirements and translate them into effective cloud based solutions.
- Follow development, testing, deployment, security, and operational best practices for enterprise cloud environments.
Required Qualifications and Experience
- Strong professional experience in Google Cloud Platform development and data engineering.
- Advanced hands-on experience with Google BigQuery and SQL, including complex queries, transformations, optimization, and large-scale data processing.
- Strong programming experience with Python for data engineering, automation, and application development.
- Hands on experience with multiple GCP native services, particularly:
- Google Dataflow
- Google Pub/Sub
- Google Cloud Composer
- Apache Airflow
- Google Cloud Storage
- Google BigQuery
- Experience designing and implementing scalable ETL/ELT data pipelines.
- Experience working with both batch and/or streaming data processing architectures.
- Strong understanding of cloud-based data engineering concepts, distributed processing, and event driven architectures.
Preferred Qualifications
- Experience with additional GCP services such as Cloud Functions, Cloud Run, IAM, Cloud Monitoring, and Cloud Logging.
- Experience with CI/CD and automated deployment of GCP data workloads.
- Experience working with large scale enterprise data platforms.
- Experience with data pipeline performance optimization and cloud cost optimization.
- Familiarity with modern data architecture and cloud native development patterns.
Click on Apply to know more.
