About the role
We are loking for skilled ETL pipeline support engineer to join DevOps team. In this role, you will be ensuring the smooth operation of PROD ETL pipelines. Also responsible for monitoring, troubleshooting existing pipelines.
This role requires a strong understanding of SQL, Spark, and experience with AWS Glue and Redshift.
Required Skills and Experience:
Bachelor's degree in Computer Science, Engineering, or a related field.
Proven experience in supporting and maintaining ETL pipelines.
Strong proficiency in SQL and experience with relational databases (e.g., Redshift).
Solid understanding of distributed computing concepts and experience with Apache Spark.
Hands-on experience with AWS Glue and other AWS data services (e.g., S3, Lambda).
Experience with data warehousing concepts and best practices.
Excellent problem-solving, analytical skills and strong communication and collaboration skills.
Ability to work independently and as part of a team.
Preferred Skills and Experience:
Experience with other ETL tools and technologies
Experience with scripting languages (e.g., Python).
Familiarity with Agile development methodologies.
Experience with data visualization tools (e.g., Tableau, Power BI).
Role
Monitor and maintain existing ETL pipelines, ensuring data quality and availability.
identify and resolve pipeline issues and data errors.
Troubleshoot data integration processes.
If needed, collaborate with data engineers and other stakeholders to resolve complex issues
Develop and maintain necessary documentation for ETL processes and pipelines.
Participate in on-call rotation for production support.
This job is sourced from a job board