Flag job

Report

Senior Data Engineer

Salary

₹22.2 - 27 LPA

Min Experience

5 years

Location

Gurugram

JobType

full-time

About the job

Info This job is sourced from a job board

About the role

Responsibilities Work closely with product managers to understand customer needs and translate those into technical requirements. Build and maintain scalable data management and serving infrastructure on cloud, managing terabytes of data and integrating cost. Design a comprehensive target data architecture vision working closely with product, design and development and NatCo teams to plan transition towards the target vision Responsible for implementation of architecture concepts in product development and services Consult and engage with engineering teams to solve problems at their root cause Create deliverables that provide exceptional clarity and connections to business objectives Assess emerging technologies and perform proof of concepts Collaborate with product teams, design teams, NatCOs, enterprise architects and provide optimized solutions that provide business outcomes Provide strategic direction and technical oversight pertaining to the implementation of new tools, technologies and solutions Data Specialization Comprehensive and expert knowledge with more than 5 years of Data Management and Data-Architectures (DWH, Spark, Lakehouse) Deep understanding of concepts and principles relating to both Batch and Streaming data, as well as API/Microservices architectures, Data warehouses & Mesh Architectures. Strong expertise in Big Data Applications, Architecture best practices, and experience with the pitfalls of legacy Data Warehouses and Big Data platforms. Al exposure and an excellent understanding of the decision engine concepts and how to best implement MLOps within an enterprise. Rich and comprehensive experience in understanding the impact of emerging trends on the organization in data tools, analysis techniques, and data usage. Experience in software engineering and programming languages (Java, Scala). Proven track record of working with globally federated IT teams, and understands the challenges involved, but can still bring teams and people together to deliver a shared outcome. Data Modelling experience (e.g., Information framework SID, Data Vault 2.0) Security and Regulatory Regiour Experienced in implementing solutions that protect sensitive and regulated Customer data and can define technically secure and regulatory sound solutions. Experienced in dealing with Security Architecture concepts like identity and access management, network isolation, transport protection, cloud security specifics, encryption & key management, and robust knowledge of data privacy treatment techniques.

Skills

Big Data Applications Architecture best practices
Security Architecture
key management
Network isolation
Lakehouse
Data Vault 2.0
Information framework SID
API Microservices architectures
Transport protection
Java
Data Modelling
Cloud security
Data Management
Scala
data warehouses
Encryption
MLops
Dwh
Spark