- Experience
- 4+ yrs
- Location
- Chennai, Tamil Nadu, India
- Job type
- Full-time
Required skills
- GCP
- BigQuery
- Composer
- Dataproc
- Dataflow
- Pub/Sub
- Databricks
- SQL
- PySpark
- Oracle
- SQL Server
- Airflow
- Git
- CI/CD
About the role
Job description
Skillset- Hands-on experience with GCP (BigQuery, Composer, Dataproc, Dataflow, Pub/Sub)
- Working knowledge of Databricks for data processing and pipelines
- Strong programming skills in SQL and PySpark
- Experience with Oracle and SQL Server databases
- Understanding of data modelling (dimensional / medallion basics)
- Experience in batch pipelines and exposure to streaming
- Familiarity with data ingestion, ETL/ELT processes
- Basic understanding of data quality and validation
- Exposure to Airflow/Composer and scheduling
- Working knowledge of Git and CI/CD
Detailed Responsibilities- Develop and maintain batch and streaming data pipelines
- Build SQL and PySpark transformations for large datasets
- Ingest data from multiple sources into BigQuery/cloud platforms
- Implement data transformation logic as per requirements
- Work with teams to consume curated datasets
- Develop workflows using Cloud Composer (Airflow)
- Perform data validation and reconciliation
- Optimise queries and pipelines for performance
- Support migration of legacy ETL jobs to cloud
- Troubleshoot pipeline and performance issues
- Participate in testing, UAT, and deployment
- Document pipelines, transformations, and sources
- Collaborate with analytics and reporting teams
Location: Chennai / Bengaluru / Hyderabad
Experience: 4+ Years
Range of Year Experience-Min Year
3
Physical Location
Chennai - MEPZ
Qualifications
Masters
Range of Year Experience-Max Year
5
About Infinite Computer Solutions
Provides digital engineering and IT transformation services for enterprises.
This page is fully interactive when JavaScript is enabled. Please enable JavaScript to apply or browse related roles.