Flag job

Report

Data Engineer - Gen AI data pipeline - Consultant

Salary

₹25 - 42 LPA

Min Experience

3 years

Location

Bengaluru

JobType

full-time

About the job

Info This job is sourced from a job board

About the role

The Data Engineer - Gen AI data pipeline - Consultant will be responsible for designing, developing, and maintaining scalable and efficient data pipelines to support Deloitte's AI and machine learning initiatives. Key responsibilities include:- Designing and implementing data ingestion, transformation, and storage solutions using big data technologies like Spark, Kafka, and Hadoop- Building robust and scalable data pipelines to ingest, process, and store large volumes of structured and unstructured data- Collaborating with data scientists and subject matter experts to understand business requirements and translate them into technical solutions- Leveraging cloud-based data and analytics services to build highly scalable and cost-effective data platforms- Automating data pipeline workflows and monitoring solutions to ensure reliable and consistent data delivery- Evaluating new technologies and tools to enhance the data engineering capabilities of the team- Contributing to the overall data strategy and roadmap for the Deloitte AI practice

About the company

Deloitte is one of the world's leading professional services firms, providing audit, tax, consulting, and advisory services to many of the world's most admired brands, including 80 percent of the Fortune 500. Our people work across more than 20 industry sectors to deliver measurable and lasting results that help reinforce public trust in our capital markets, inspire clients to see challenges as opportunities to transform and thrive, and help lead the way toward a stronger economy and a healthier society.

Skills

spark
kafka
hadoop
data-engineering
cloud
data-pipeline