ETL Developer with Azure Databricks

ETL Developer with Azure Databricks

Location: Remote – anywhere in US

Type: ongoing on W2

Key Skills & Requirements:

• 5+ years of experience in creating ETL jobs using Azure Databricks with Oracle and SQL Server as backend.
• Strong understanding of ETL concepts including full load and incremental load using Databricks and Azure Data Factory (ADF) pipelines.
• Experience in creating ETL pipelines with Azure Data Factory and sequencing Databricks jobs in ADF.
• Experience in creating reusable notebooks in Azure Databricks, including the use of functions and parameters.
• Proficiency in Python programming language.
• Strong Oracle and SQL Server query experience, with knowledge of CTEs, ANSI SQL, and Oracle functions.
• Experience with SQL set operators such as MINUS, EXCEPT, UNION, etc.
• Proficiency in creating PL/SQL blocks, triggers, and indexes.
• Experience in query performance tuning, including working with indexes and partitions.
• Strong troubleshooting and defect resolution skills.
• Excellent communication and client-facing skills.