Website:
sotalent.us
Job details:
Job Title: Senior Data & Analytics Engineer
Location: Bengaluru, Karnataka, India
Type: Full Time
Our Client is seeking a talented Senior Data & Analytics Engineer to design, build, and optimize modern data solutions across the Azure ecosystem. In this role, you’ll architect scalable data pipelines, enhance analytical platforms, and collaborate closely with business and technical teams to deliver high‑quality, secure, and reliable data products—especially within supply‑chain‑focused environments.
Key Responsibilities
- Build and manage cloud‑based data platforms, including data lakes, warehouses, and integration solutions.
- Develop and optimize end‑to‑end data pipelines using Azure Data Factory, Azure Databricks (PySpark/Spark SQL), Azure Data Lake, Azure Synapse, and Azure SQL.
- Implement monitoring, observability, automation, and alerting frameworks to ensure seamless pipeline operations.
- Manage production deployments, compute resources, data security configurations, and operational resiliency.
- Troubleshoot performance issues, enhance pipeline stability, and adapt solutions to evolving business needs.
- Apply cloud best practices related to architecture, governance, security (RBAC, Key Vault, RLS/OLS), cost efficiency, and scalability.
- Use DataOps/DevOps practices such as Git/Bitbucket and CI/CD pipelines (Azure DevOps or Jenkins).
- Collaborate with stakeholders to translate business requirements into scalable data products and lead POC/solution discussions.
- (Preferred) Bring knowledge of supply chain processes: planning, sourcing, manufacturing, logistics, and customer operations.
Required Qualifications
- Bachelor’s degree in Engineering, Computer Science, IT, Data Analytics, or a related field.
- 4–6 years of experience in Azure Data Engineering & Power BI.
- Hands‑on expertise with:
- Azure Databricks (PySpark/Spark SQL) / Microsoft Fabric
- Azure Data Factory, Data Lake, Synapse, Azure SQL
- Advanced SQL/T‑SQL
- Experience with Git/Bitbucket and CI/CD tools (Azure DevOps/Jenkins).
- Strong scripting, data modeling, and cloud architecture fundamentals.
- Excellent communication skills and ability to guide/mentor peers.
Preferred Qualifications
- Certifications such as:
- Azure Data Engineer Associate (DP‑203)
- Databricks Data Engineer (Associate/Professional)
- Experience in data migration or modernization projects (legacy ETL/BI → Azure-native).
- Background in supply chain or CPG analytics.
- Master’s degree in a relevant field is a plus.
Click on Apply to know more.