About the role
Altimetrik is looking for a PySpark Developer to join our team. As a PySpark Developer, you will be responsible for designing, developing, and maintaining scalable and efficient data processing pipelines using PySpark. You will work closely with data engineers, data analysts, and business stakeholders to understand their requirements and deliver data-driven solutions. Key responsibilities include:
- Develop and optimize PySpark scripts for data extraction, transformation, and loading (ETL) processes
- Implement efficient data processing workflows using PySpark's DataFrames and Structured Streaming
- Ensure data quality, reliability, and security throughout the data pipeline
- Collaborate with cross-functional teams to enhance and scale the data infrastructure
- Stay up-to-date with the latest PySpark and big data technologies and best practices
About the company
Altimetrik is a global digital transformation company that helps enterprises accelerate their digital journey. We are a team of passionate problem-solvers, driven by a desire to create innovative solutions that make a real impact.
This job is sourced from a job board