Engineer - Data Engineering (Chennai, TN, IN, 600113)

IDMC MDM & DQ, Databricks, ETL, SQL, data profiling, data quality

• The role requires a strong command of Data Bricks, ETL processes, and Data Quality (DQ) management, tailored to the needs of Takeda Pharmaceuticals International AG.
• Proficiency in Data Bricks is essential, as it enables the design and optimization of data pipelines and frameworks within cloud environments, allowing for efficient data processing and analysis.
• Professionals in this field should possess advanced skills to leverage Data Bricks for building scalable data solutions and automating workflows, ensuring high performance and reliability in data operations.
• ETL (Extract, Transform, Load) expertise is critical, as it involves the ability to integrate data from multiple sources into a cohesive framework, transforming raw data into meaningful insights.
• Candidates should have substantial experience in designing robust ETL processes, optimizing data flows, and ensuring seamless data movement across various platforms.
• This includes familiarity with various ETL tools and techniques to maintain efficiency and data integrity.
• Data Quality (DQ) management is another pivotal skill, focusing on the accuracy, completeness, and reliability of data throughout its lifecycle.
• Professionals should be adept at implementing DQ frameworks and monitoring metrics to ensure high-quality data is maintained consistently across all data repositories.
• This involves conducting regular data audits and applying validation techniques to address any discrepancies proactively.
• In terms of educational background, candidates are expected to hold a Master of Technology (M.Tech) in Data Science or Data Engineering, complemented by a Bachelor of Technology (B.Tech) in Computer Science and Engineering, ideally with a specialization in Data Engineering or Big Data Analytics.
• Certifications such as Certified Data Management Professional (CDMP) and AWS Certified Data Analytics – Specialty are preferred, as they validate the candidate’s expertise and commitment to maintaining industry standards in data management and analytics.

• Design, develop, and implement ETL processes to efficiently extract, transform, and load data into data warehouses using Data Bricks.
• Collaborate with data architects and analysts to understand data requirements and ensure alignment with overall data strategy.
• Monitor and maintain data quality (DQ) standards and implement procedures to address data quality issues across various systems and datasets.
• Work with PostgreSQL databases to optimize queries and improve performance for data retrieval and reporting tasks.
• Participate in the development of data models and data architecture to support analytical and reporting needs.
• Conduct data profiling and analysis to identify trends, anomalies, and opportunities for improving data processes.
• Lead initiatives to enhance data governance and management practices within the organization.
• Mentor and train junior data engineers on best practices in ETL development and data quality management.
• Stay updated on emerging data engineering tools and methodologies to continuously improve data processes.

IDMC MDM & DQ, Databricks, ETL, PostGreSQL

AI-first data engineering solutions provider