Data Engineer GCP
Randstad
- Location
- Hyderabad, Telangana, India
- Job type
- Full-time
Required skills
- Python
- automated testing
- BigQuery
- cloud infrastructure
- data engineer
- DevOps
- GCP
- GitLab
- Google Cloud
- SQL
- Terraform
- version control
About the role
Randstad
Website:
randstad.com
Job details:
Key Responsibilities
- Looking for 3 to 10 Years of experience as a Data Engineer
- Pipeline Development: Build and scale streaming data pipelines using Pub/Sub and Cloud Functions following existing ingestion frameworks.
- Infrastructure as Code: Development and deployment of data resources using Terraform, ensuring all environments are reproducible and secure.
- Observability & Reliability: Implement comprehensive Cloud Logging and Cloud Monitoring strategies.
- Collaboration: Partner with Data Analysts and Product teams to ensure the underlying data infrastructure supports high-level business requirements.
- Software Engineering Best Practices: Apply engineering principles to development, including version control (GitLab) and CI/CD.
Qualifications & Skills
- GCP Ecosystem: Minimum 1 year of hands-on experience with Google Cloud Platform, specifically BigQuery, Pub/Sub, Cloud Functions and Cloud Storage.
- BigQuery: Proven experience writing efficient SQL queries in BigQuery.
- Terraform: Experience with Terraform modules to manage cloud infrastructure.
- Programming: Experience in Python for data processing tasks preferred.
- DevOps Mindset: Strong understanding of CI/CD pipelines and the importance of automated testing in data environments.
- The "Quality" Mindset: A passion for clean code, documentation and automated data validation.
Click on Apply to know more.
This page is fully interactive when JavaScript is enabled. Please enable JavaScript to apply or browse related roles.