Anlage Digital
Website:
apbank.ch
Company:
https://www.linkedin.com/company/anlage-gcc-services
Seniority: Mid-Senior level
Industries: IT Services and IT Consulting
Job details:
Hi,
Urgently looking out for Lead Data Engineer with one of my esteemed client for Kochi, Chennai, Coimbatore, Mumbai, Pune location.
Years of experince:10-15 Years
Location: Kochi, Chennai, Coimbatore, Mumbai, Pune
***Only Immediate joiners should apply ***
Role Summary
We are seeking a strong Data Engineer with hands-on expertise in Databricks, PySpark, and SQL/T-SQL interpretation to support a
legacy-to-Databricks migration program. The ideal candidate should have worked predominantly as a Data Engineer throughout their
career, ideally beginning with Oracle, SQL Server/T-SQL, ETL, or Data Warehouse technologies and later transitioning into modern
cloud-based Data Engineering. The role requires the ability to understand existing T-SQL logic and migrate transformation rules into
scalable Databricks and PySpark solutions.
Important screening criterion: The candidate must have worked predominantly and consistently as a Data
Engineer throughout their career. Profiles that are primarily BI, reporting, dashboarding, analytics, or only recently
shifted into data engineering should not be prioritized.
Roles & Responsibilities
• Analyze legacy data warehouse, SQL Server, Oracle, ETL, and T-SQL based implementations for migration to Databricks.
• Read and interpret complex T-SQL scripts, stored procedures, functions, views, joins, transformation rules, and data flows.
• Convert business logic from legacy SQL/T-SQL processes into optimized Databricks and PySpark workflows.
• Design, develop, and maintain scalable ETL/ELT pipelines in Databricks.
• Support ingestion, transformation, validation, and reconciliation of enterprise data across legacy and modern platforms.
• Collaborate with architects, senior engineers, business analysts, and migration teams to understand source-to-target mapping
requirements.
• Perform data quality checks, unit testing, integration testing, and defect resolution during migration execution.
• Optimize PySpark jobs, SQL queries, and Databricks notebooks for better performance and reliability.
• Document migration logic, transformation rules, dependencies, and technical design details.
• Participate in code reviews and follow Data Engineering best practices.
Must Have Skills
•8+ years of relevant Data Engineering experience, with the majority of career spent in Data Engineering roles.
• Strong hands-on experience in Databricks development.
• Strong PySpark programming experience for data transformation and pipeline development.
• Strong SQL/T-SQL understanding, especially the ability to read and interpret existing T-SQL code.
• Experience in legacy data technologies such as SQL Server, Oracle, traditional ETL tools, or Data Warehouse platforms.
• Experience in ETL/ELT development, data ingestion, transformation, and data pipeline implementation.
• Good understanding of Data Warehousing, Data Modeling, and dimensional concepts.
• Ability to migrate or re-engineer legacy SQL/ETL logic into Databricks/PySpark.
• Strong analytical, debugging, and problem-solving skills.
• Good communication skills to work with technical and business teams.
Candidates interested in the above mentioned Job Description can shared across their updated resume at ramandeep.k@anlage.co.in
Click on Apply to know more.
