Flag job

Report

Data Engineer (Consultant)

Min Experience

2 years

Location

remote

JobType

full-time

About the job

Info This job is sourced from a job board

About the role

I have 2.5 years of experience as a Data Engineer, specializing in designing and developing scalable data solutions on Microsoft Azure. My responsibilities have included building robust data pipelines using Azure Data Factory, managing and transforming data with Azure Databricks and Data Lake, and implementing efficient data models in Azure Synapse Analytics. I have hands-on experience with PySpark, SQL, and Python, and have worked with both batch and streaming data. I've contributed to optimizing ETL workflows and ensuring data quality and governance across projects. One of my key achievements was reducing data processing time by 40% by optimizing pipeline logic and leveraging parallelism in Azure. I'm passionate about leveraging cloud technologies to deliver high-quality, secure, and reliable data solutions that support advanced analytics and AI initiatives.

Skills

pyspark
sql
python