Senior Data Engineer - Snowflake

Responsibilities:
 

• Design, develop, and maintain robust and scalable data pipelines for ELT and ETL processes, ensuring data accuracy, completeness, and timeliness.
   
• Work with stakeholders to understand data requirements and translate them into efficient data models and pipelines.
   
• Build and optimize data pipelines using a variety of technologies, including Elastic Search, AWS S3, Snowflake, and NFS.
   
• Develop and maintain data warehouse schemas and ETL/ELT processes to support business intelligence and analytics needs.
   
• Implement data quality checks and monitoring to ensure data integrity and identify potential issues.
   
• Collaborate with data scientists and analysts to ensure data accessibility and usability for various analytical purposes.
   
• Stay current with industry best practices, CI/CD/DevSecFinOps, Scrum and emerging technologies in data engineering.
   
• Contribute to the development and enhancement of our data warehouse architecture
   

Requirements

Mandatory:
 

• Bachelor's degree in Computer Science, Engineering, or a related field.
   
• 5+ years of experience as a Data Engineer with a strong focus on ELT/ETL processes.
   
• At least 3+ years of exp in Snowflake data warehousing technologies.
   
• At least 3+ years of exp in creating and maintaining Airflow ETL pipelines.
   
• Minimum 3+ years of professional level experience with Python languages for data manipulation and automation.
   
• Working experience with Elastic Search and its application in data pipelines.
   
• Proficiency in SQL and experience with data modelling techniques.
   
• Strong understanding of cloud-based data storage solutions such as AWS S3.
   
• Experience working with NFS and other file storage systems.
   
• Excellent problem-solving and analytical skills.
   
• Strong communication and collaboration skills.