AWS Glue Developer

AWS Glue Developer About the role: As an AWS Glue Developer, you will be responsible for designing, developing, and deploying AWS Glue ETL pipelines to ingest, transform, and load data from various sources into AWS data stores. You will work closely with data engineers, data architects, and business stakeholders to understand their data requirements and implement efficient and scalable data processing solutions using AWS Glue. Key responsibilities: - Design and develop AWS Glue ETL jobs and workflows to extract, transform, and load data from diverse sources (e.g., S3, RDS, Redshift, etc.) into target data stores - Write efficient and maintainable Spark code (Python or Scala) for data transformation and data quality checks - Implement data cataloging and data discovery using AWS Glue Data Catalog - Automate the deployment of AWS Glue jobs and workflows using CI/CD pipelines - Monitor and troubleshoot AWS Glue job executions, identify and resolve performance bottlenecks - Collaborate with data engineers, data architects, and business stakeholders to understand their data requirements and design scalable data processing solutions - Stay updated with the latest AWS Glue features and best practices, and contribute to the development of robust data engineering practices Requirements: - 3+ years of experience in data engineering or ETL development - Strong proficiency in Python or Scala programming for data transformation and data quality checks - Hands-on experience in designing and developing AWS Glue ETL pipelines, including custom Spark code - Familiarity with AWS data services (e.g., S3, Redshift, RDS, Athena, etc.) and their integration with AWS Glue - Understanding of data modeling concepts, data warehousing, and data lake architectures - Experience in setting up CI/CD pipelines for the deployment of AWS Glue jobs - Strong problem-solving and analytical skills, with the ability to work independently and as part of a team - Excellent communication and collaboration skills to work with cross-functional teams

Amdocs is a leading provider of software and services to communications and media companies. For more than 40 years, Amdocs solutions and services have enabled service providers around the world to innovate and thrive in the connected digital world. Amdocs delivers end-to-end platform solutions and services that enable its customers to embrace the cloud, build the future of customer experience, and optimize their operations.