- Location
- Bangalore Urban, Karnataka, India
- Job type
- Full-time
Required skills
- Python
- Airflow
- Apache
- Apache Airflow
- Apache Flink
- Apache Spark
- Azure
- containerization
- data analytics
- data pipeline
- DevOps
- Docker
- Flink
- GitHub
- Gradle
- Hadoop
- Hive
- Maven
- Spark
About the role
Optimum Solutions Pte Ltd
Website:
theoptimum.net
Job details:
- 8+ years of experience developing high-quality, scalable products and applications.
- Bachelor’s degree in Computer Science, Engineering, or an equivalent discipline is required; a Master’s degree is preferred.
- Strong hands-on experience with Hadoop technologies, including Hive, HDFS, Iceberg, and StarRocks.
- Proficiency in Apache Spark, Scala, Python, and/or Apache Flink, with experience in data processing and distributed computing.
- Experience with Apache Airflow for workflow orchestration and data pipeline management.
- Hands-on experience with Microsoft Azure cloud services and containerization tools such as Docker.
- Strong knowledge of CI/CD pipelines, Azure DevOps (ADO), Maven, Gradle, GitHub, and continuous build processes.
- Understanding of code quality and analysis tools such as SonarQube, along with DevOps best practices.
- Expertise in Spark application design, performance optimization, integration patterns, data analytics, and data-loading techniques.
- Ability to perform resource monitoring, benchmarking, and troubleshooting, while collaborating effectively and adapting to new technologies; relevant industry certifications are an added advantage.
Click on Apply to know more.
This page is fully interactive when JavaScript is enabled. Please enable JavaScript to apply or browse related roles.