Info Way Solutions
Website:
infowaygroup.com
Job details:
Job Title: Data Platform Engineer (AWS, Kubernetes, Spark, Airflow)
Job Description:
We are seeking a skilled Data Platform Engineer to design, build, and maintain scalable data pipelines and platforms on AWS. The role involves working with Apache Spark for data processing, Apache Airflow for workflow orchestration, and Kubernetes for containerized deployments. You will collaborate with data, DevOps, and analytics teams to ensure reliable, high-performance data solutions.
Key Responsibilities:
- Develop and manage data pipelines using Spark and Airflow
- Deploy and maintain applications on Kubernetes
- Build scalable data solutions on AWS (S3, EMR, EKS, etc.)
- Optimize data workflows for performance and reliability
- Collaborate with cross-functional teams
Required Skills:
- Strong experience in AWS cloud services
- Hands-on with Apache Spark and Airflow
- Experience with Kubernetes and containerization
- Proficiency in Python/Scala
- Good understanding of data engineering concepts
Click on Apply to know more.