About the role
Skills and Experience:Degree in Data Analytics/Computer Science or equivalent work experience3 years plus experience as an Azure Data Engineer or in a similar data engineering role using Microsoft Azure Cloud (Data Factory, Azure Functions, Databricks, etc.).Practical Experience to Azure Fabric (Ideally DP-700 certified)Proven experience in building and optimising big data pipelines and architecturesStrong analytical skills, especially in working with unstructured dataProficient in designing and implementing well-written codeExperience with data pipeline testing, from source to presentation layer including troubleshooting skillsKey ResponsibilitiesDesign, implement, and maintain data pipelines for data ingestion, processing, and transformation in Azure.Work together with data scientists and analysts to understand the needs for data and create effective data workflows.Create and maintain data storage solutions including Azure SQL Database, Azure Data Lake, and Azure Blob Storage.Utilizing Azure Data Factory or comparable technologies, create and maintain ETL (Extract, Transform, Load) operations.Implementing data validation and cleansing procedures will ensure the quality, integrity, and dependability of the data.Improve the scalability, efficiency, and cost-effectiveness of data pipelines.Monitoring and resolving data pipeline problems will guarantee consistency and availability of the data.
This job is sourced from a job board