Viraaj HR Solutions Private Limited
Website:
viraajhrsolutions.com
Job details:
Role & Responsibilities
- Design, develop, and optimize data pipelines using PySpark for large-scale data processing.
- Collaborate with data engineering and analytics teams to translate business requirements into technical solutions.
- Implement ETL processes to support data integration and reporting tasks.
- Ensure data quality and consistency across all data workflows.
- Monitor and troubleshoot Spark jobs to ensure high performance and reliability.
- Document data processes and develop best practices for team adoption.
Skills & QualificationsMust-Have
- Proficiency in PySpark and Apache Spark framework
- Strong programming skills in Python
- Experience with SQL and data modeling
- Understanding of Big Data architecture and principles
- Hands-on experience with ETL processes
- Knowledge of distributed computing concepts
- Ability to troubleshoot and optimize Spark jobs
Preferred
- Experience with cloud platforms like AWS or Azure
- Knowledge of containerization and orchestration tools such as Docker and Kubernetes
Benefits & Culture Highlights
- Opportunity to work with cutting-edge Big Data technologies
- Collaborative and innovative work environment
- On-site role offering professional growth and learning opportunities
Skills: apache spark,sql,python,big data,data processing
Click on Apply to know more.