Role – ETL Lead - ETL Development with AWS Glue
Work Location - Bangalore
Job Mode – WFO
Experience Required – 7 - 10 Yrs
Job Type - Permanent
Notice Period - Immediate to 15 days
Role Overview: -
We are seeking an experienced and dynamic ETL Developer with expertise in AWS Glue to join our data engineering team. The ideal candidate will be responsible for designing, implementing, and maintaining data pipelines, integrating data from diverse sources, and ensuring high-quality data for analytical and business intelligence purposes. The successful candidate will work with AWS Glue, AWS S3, and other AWS services to manage the ETL (Extract, Transform, Load) process efficiently.
Key Responsibilities
- ETL Design and Development:
- Design, implement, and manage scalable ETL pipelines using AWS Glue to ingest, transform, and load data into data lakes, data warehouses, and other data repositories.
- Collaborate with business and data teams to understand requirements, design data models, and develop solutions that meet business needs.
- Implement automated ETL processes to improve the efficiency of data processing.
- Data Transformation:
- Use AWS Glue’s Spark-based environment to develop complex transformations, aggregations, and data cleansing operations.
- Leverage Python or Scala to write custom transformation logic.
- Data Integration:
- Integrate data from multiple heterogeneous sources such as relational databases, NoSQL stores, flat files, APIs, and third-party systems into AWS data lakes and warehouses.
- Work with AWS services like S3, Redshift, RDS, Lambda, and DynamoDB to handle the integration of large datasets.
- ETL Development with AWS Glue
Qualifications: -
- Bachelors/masters in I.T or equivalent
