About the role
Technologies:
Cloud: Azure Synapse, Azure Data Factory, Databricks/Python
On premise: SQL, SSIS, C#, Powershell
Github, CI/CD and source control
Key Experience:
Ingesting data from various structured and non-structured sources – SQL DB, Excel, API, flat file, etc
Complex Data transformations
Ability to understand the solution and trace integrations without any documentation
Building and optimizing parameterised and dynamic ETL data pipelines
Problem solving and troubleshooting data related challenges impacting nested system integrations
Ideal experience:
Development and Cloud migration projects
Key knowledge:
Data warehousing
ETL processes, data transformation, and automation
Good understanding of differences between one premise and cloud data warehousing