Insight Global
Website:
insightglobal.com
Company:
https://www.linkedin.com/company/insight-global
Seniority: Mid-Senior level
Industries: Electrical Equipment Manufacturing and Manufacturing
Job details:
Job Description:
This role is a highly technical Data Quality Engineer supporting enterprise data validation and quality engineer efforts across the Azure/Databricks platform. As a senior level developer, this role requires expertise in data testing, automation, distributed systems, and modern data architectures. Other key responsibilities include:
- Design and implement end-to-end data validation strategies for pipelines built on Azure Data Factory, Databricks (Delta Lake), and ADLS
- Build and perform large-scale data validation using Python and Spark-based validation frameworks
- Validate data movement, orchestration workflows, and failure handling
- Define and implement data quality SLAs and KPIs along with tracking data/pipeline health
- Drive best practices for data quality and testing standards
Must Haves
- 6-8+ years' experience in data quality engineer, SDET, data engineering testing, etc.
- Strong hands-on experience with Azure Data Factory, Databricks (PySpark), and SQL for data quality validation
- Proven experience building automated data quality frameworks from scratch
- Strong understanding of data governance, lineage, and metadata
- Experience integrating with enterprise systems (ERP, CRM, MDM, etc.)
Plusses
- Data observability platforms (Monte Carlo, Soda, Datadog)
- Experience building CI/CD data testing pipelines (Azure DevOps / GitHub Actions)
- Streaming Technologies (Kafka, Event Hub)
- Hands-on experience with dbt (Data Built Tool)
- Azure Data Engineer (DP-203) Certification or Databricks Certified Professional
- Experience within supply chain or large enterprise data environments
Click on Apply to know more.
