Innova ESI
Website:
innovaesi.com
Job details:
Position: Senior PySpark ETL Engineer
Role Summary
The Senior PySpark ETL Engineer
is responsible for designing, building, optimizing, andoperating scalable data pipelines using
Apache Spark (PySpark) . This role focuses on highvolume batch (and optionally streaming) data processing , ensuring performance, reliability, data quality, and cost effi ciency across enterprise dataplatforms. The position requires strong python
,
handson Spark expertise, deep SQL and datamodeling knowledge, and the ability to own pipelines end to end in production.
.
Mandatory Requirements
10–12 years of overall IT experience, with strong focus on data engineeringand ETL
.3+ years of handson experience with PySpark / Apache Spark in productionenvironments.
Strong experience designing and implementing ETL / ELT pipelines at scale.
Excellent knowledge of SQL and relational data concepts.
Experience handling large datasets in distributed environments.
Strong ownership mindset, problem solving skills, and ability to independentlyhandle production pipelines.
Click on Apply to know more.