UST
Website:
ust.com
Job details:
Role Description
Who we are:
At UST, we help the world’s best organizations grow and succeed through transformation. Bringing together the right talent, tools, and ideas, we work with our client to co-create lasting change. Together, with over 30,000 employees in 30+ countries, we build for boundless impact—touching billions of lives in the process. Visit us at .
Summary
UST is looking for a Data Engineer with Spark & Streaming skills builds real-time, scalable data pipelines using tools like Spark, Kafka, and cloud services (GCP) to ingest, transform, and deliver data for analytics and ML.
The Opportunity
- As a Senior Data Engineer, you will Design, develop, and maintain ETL/ELT data pipelines for batch and real-time data ingestion, transformation, and loading using Spark (PySpark/Scala) and streaming technologies (Kafka, Flink).
- Build and optimize scalable data architectures, including data lakes, data warehouses (BigQuery), and streaming platforms.
- Performance Tuning: Optimize Spark jobs, SQL queries, and data processing workflows for speed, efficiency, and cost-effectiveness
- Data Quality: Implement data quality checks, monitoring, and ing systems to ensure data accuracy and consistency.
What You Need
- Programming: Strong proficiency in Python, SQL, and potentially Scala/Java.
- Big Data: Expertise in Apache Spark (Spark SQL, DataFrames, Streaming).
- Streaming: Experience with messaging queues like Apache Kafka, or Pub/Sub.
- Cloud: Familiarity with GCP, Azure data services.
- Databases: Knowledge of data warehousing (Snowflake, Redshift) and NoSQL databases.
- Tools: Experience with Airflow, Databricks, Docker, Kubernetes is a plus.
Required Skills
big data,hadoop,spark,scala,python,
Qualification
Bachelor’s degree.
What We Believe
We’re proud to embrace the same values that have shaped UST since the beginning. Since day one, we’ve been building enduring relationships and a culture of integrity. And today, it's those same values that are inspiring us to encourage innovation from everyone, to champion diversity and inclusion and to place people at the centre of everything we do.
Humility
We will listen, learn, be empathetic and help selflessly in our interactions with everyone.
Humanity
Through business, we will better the lives of those less fortunate than ourselves.
Integrity
We honour our commitments and act with responsibility in all our relationships.
Equal Employment Opportunity Statement
UST is an Equal Opportunity Employer. We believe that no one should be discriminated against because of their differences, such as age, disability, ethnicity, gender, gender identity and expression, religion, or sexual orientation.
All employment decisions shall be made without regard to age, race, creed, colour, religion, sex, national origin, ancestry, disability status, veteran status, sexual orientation, gender identity or expression, genetic information, marital status, citizenship status or any other basis as protected by federal, state, or local law.
UST reserves the right to periodically redefine your roles and responsibilities based on the requirements of the organization and/or your performance.
- To support and promote the values of UST.
- Comply with all Company policies and procedures
Skills
big data,hadoop,spark,scala,python,
Click on Apply to know more.