Website:
mindbrain.co.in
Job details:
Job Title: SDET – Data / ETL (Offshore)
Experience: 6+ Years
Location: Remote
Duration: ~3 Months (Contract)
Notice Period: Immediate Joiners Only
Job Summary
We are looking for a highly skilled SDET – Data / ETL professional with strong expertise in data pipeline testing, ETL validation, and automation. The ideal candidate will have hands-on experience in PySpark, Python, and SQL, along with a solid understanding of data quality, reconciliation, and large-scale data validation.
Key Responsibilities
- Perform testing and validation of data pipelines and ETL workflows.
- Validate ETL transformations and ensure reconciliation between source and target systems.
- Develop automated validation scripts using PySpark and Python.
- Execute SQL-based data validation across large datasets.
- Support and enhance automation frameworks for data pipeline testing.
- Collaborate with Data Engineering, QA, and Product teams in Agile environments.
- Identify defects, perform root cause analysis, and troubleshoot issues.
- Ensure data quality, accuracy, and consistency across systems.
Required Skills
- Strong hands-on experience in PySpark.
- Strong SQL skills for data validation and reconciliation.
- Experience in ETL/Data pipeline testing.
- Expertise in building automation scripts using Python/PySpark.
- Familiarity with cloud data platforms (AWS preferred).
- Understanding of data validation, data quality, and large dataset testing.
- Experience working in Agile/Scrum environments.
- Experience with Databricks, AWS Glue, or Spark pipelines.
Click on Apply to know more.