Azure Data Engineer

Developed and maintained ETL processes that moved over 1TB of data per day from source systems to Snowflake, ensuring data accuracy and completeness. Migrating the source data source to the new instance. Created ADF pipelines to load data from Source to AIDR. Experience with various Azure data storage solutions such as Azure Cosmos DB, Azure Data Lake Storage, and Azure Blob Storage. Creating Data pipelines in ADF connecting from Source to the sink Creating CR and PR for implementing new changes in production. Analyzing the failures and reason and resolving known issues. Decommissioning the Pipelines which are not in Use. Analyzing and fixing the data refresh is...