UST
Website:
ust.com
Job details:
Role Description
Senior Data Engineer
Total Experience: 5-7 Years
Job Summary
We are looking for a highly skilled Data Engineer. The engineer will be responsible for building, enhancing, and supporting scalable data pipelines and transformation frameworks that power enterprise-grade data products.
The platform leverages Snowflake as the enterprise data lake, with Oracle GoldenGate, Kafka, and Java-based microservices enabling high-volume real-time and batch data ingestion and transformation. The role involves close collaboration with architects, business teams, and external customer integration teams.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Snowflake, Kafka, and Oracle GoldenGate.
- Develop and enhance Java-based microservices for data transformation and ingestion into Snowflake staging layers.
- Create and optimize Snowflake tables, views, streams, tasks, and stored procedures.
- Build reusable ingestion and transformation frameworks for structured and semi-structured data.
- Develop high-performance SQL queries and optimize Snowflake workloads.
- Support near real-time and batch data integration processes.
- Collaborate with downstream consumers and external customer teams for data exposure and integration.
- Troubleshoot production issues and perform root cause analysis.
- Implement data validation, reconciliation, and monitoring mechanisms.
- Participate in CI/CD, automation, and DevOps initiatives.
Required Skills
- Strong experience in Snowflake development and optimization.
- Hands-on experience with Kafka and streaming architectures.
- Experience with Oracle GoldenGate replication technologies.
- Strong Java programming experience with microservices architecture.
- Expertise in SQL and relational database concepts.
- Experience in ETL/ELT pipeline development.
- Understanding of data warehousing and data lake concepts.
- Experience with Linux/Unix environments and shell scripting.
- Familiarity with Git, Jenkins, and CI/CD pipelines.
Preferred Skills
- Experience with telecom or enterprise data platforms.
- Knowledge of cloud platforms such as AWS or Azure.
- Exposure to Airflow or workflow orchestration tools.
- Understanding of data governance and security standards.
Education
Bachelor’s degree in Computer Science, Engineering, or related field.
Skills
data architecture,oracle goldengate,snowflake,etl,java,kafka,
Click on Apply to know more.