Thrive IT Systems
Website:
thriveitsystems.com
Job details:
Data flow developer
Remote - Anywhere in India
6-months contract
Must skills: Java, GCP, SQL, Apache Beam
We are seeking an experienced Apache Beam Java Developer with expertise in Google Cloud Dataflow to join our dynamic team. The ideal candidate will have a minimum of 5 years of hands-on experience in developing and integrating data pipelines using Apache Beam on GCP Dataflow. The candidate should have strong Java programming skills along with experience in cloud-based data processing and system integration.
Key Responsibilities:
Design, develop, and implement scalable data pipelines using
Apache Beam with Java on Google Cloud Dataflow.
Collaborate with business and technical teams to gather requirements and translate them into technical solutions.
Optimize data processing pipelines for performance, reliability, and cost efficiency.
Develop unit and integration tests to ensure data accuracy and quality.
Troubleshoot and resolve issues related to data pipelines and system integrations.
Ensure data security and compliance standards are met across the data processing workflows.
Participate in code reviews and provide constructive feedback.
Document technical designs, processes, and procedures.
Required Skills:
Minimum of 2 years of experience in Apache Beam with Java development.
5+ yrs of Java Experience
Strong knowledge of Google Cloud Platform (GCP) services, especially Dataflow, Pub/Sub, and Cloud Storage.
Hands-on experience in developing batch and streaming data pipelines.
Proficient in Java 8 or higher with a solid understanding of multithreading and performance optimization.
Experience with data integrations and data transformation workflows.
Strong knowledge of SQL and databases.
Experience in CI/CD pipelines(Jenkins) and version control tools like Git.
Excellent problem-solving skills and attention to detail.
Ability to work independently and as part of a collaborative team.
Education
Bachelor's degree
Click on Apply to know more.