Thema Corporate Services
Website:
themaservices.com
Job details:
Job description
Position: Lead Data Engineer
Location: Mumbai
Experience: 8+ years
Degree: Bachelor’s degree or a related field.
About the job
Designing, building, and maintaining data pipelines using cloud technologies to
ensure efficient data flow and quality for analysis by data scientists and business users.
Key Responsibilities.
• Data ingestion and extraction: Utilize Airbyte to establish connections to
various data sources, configure data extraction pipelines, and manage data
replication schedules.
• Data transformation with dbt: Write dbt models to clean, transform, and
aggregate data according to business requirements, leveraging dbt's declarative
syntax for maintainable data pipelines.
• Snowflake data modeling: Design and implement data models in Snowflake,
optimizing for performance and query efficiency, including dimensional
modeling techniques.
• Pipeline monitoring and maintenance: Monitor data pipelines for errors,
troubleshoot issues, and implement alerts to ensure data quality and reliability.
• Data quality checks: Implement data validation processes to identify and
address data inconsistencies or errors before loading into Snowflake.
• Collaboration with stakeholders: Work closely with data analysts, data
scientists, and business teams to understand data needs, define data
requirements, and deliver actionable insights.
Required skills:
Data Architect Experience
• SQL - Strong SQL skills to query, manipulate, and transform data
• Airbyte - Understanding of Airbyte connectors, configuration, and data
synchronization capabilities.
DBA -DataBase Administration
• dbt - Familiarity with dbt syntax, development workflow, and best practices
for data transformation.
• Snowflake - Understanding of Snowflake architecture, data warehousing
concepts, and performance optimization techniques.
• Cloud computing skills - Familiarity with cloud platforms like AWS, Azure.
• Knowledge of ETL/ELT processes, data modelling, data quality best
practices, and change data capture (CDC).
Click on Apply to know more.