Weekday (YC W21)
Website:
weekday.works
Job details:
This role is for one of the Weekday's clients
Salary range: Rs 1200000 - Rs 1800000 (ie INR 12-18 LPA)
Min Experience: 3 years
Location: Chennai
JobType: full-time
We are seeking a highly skilled Data Engineer - GCP with strong expertise in building scalable data platforms, designing robust data pipelines, and driving enterprise data transformation initiatives. The ideal candidate will combine deep technical knowledge with strategic thinking, enabling the design and optimization of modern cloud-based data ecosystems.
This role requires hands-on engineering capabilities along with the ability to mentor team members, collaborate with architects, and deliver high-quality solutions in dynamic environments.
Requirements
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Python, Spark/Scala, SQL, and Hive
- Build and optimize data solutions on Google Cloud Platform (GCP), including BigQuery, Cloud Storage, Dataproc, Dataflow, Cloud Composer, Cloud SQL, and Pub/Sub
- Implement infrastructure-as-code using Terraform for scalable cloud deployments
- Work with Hadoop ecosystem tools and Kafka for distributed data processing
- Redesign and optimize data flows to eliminate recurring data quality and performance issues
- Develop data transformation frameworks and automation solutions
- Provide technical leadership and mentor junior engineers
- Collaborate closely with IT architects to define data strategy and architectural standards
- Deliver strategic guidance to stakeholders on enterprise data transformation initiatives
- Support agile/lean development methodologies and ensure timely project delivery
- Apply Test-Driven Development (TDD) and software craftsmanship best practices
- Maintain code repositories using GitHub or other version-control systems
Required Skills & Experience
- 3+ years of hands-on experience with Hive, Python, Spark/Scala, and SQL
- Strong expertise in Google Cloud Platform (GCP), including BigQuery and related data services
- Experience with Hadoop ecosystem technologies and Kafka
- Familiarity with big data platforms and machine learning tools
- Experience with BI and ETL tools such as Alteryx, DataStage, QlikSense, or similar
- Strong analytical and problem-solving skills
- Excellent written and verbal communication skills with strong presentation abilities
- Ability to work independently as well as in global, cross-functional teams
- Experience with Agile methodologies and delivering within deadlines
- Exposure to version-control systems and development tools
Core Competencies
- GCP & BigQuery
- Data Pipeline Design & Optimization
- SQL & Python
- Distributed Data Processing
- Cloud Infrastructure & Automation
- Stakeholder Communication & Strategic Alignment
Click on Apply to know more.