L3 Support Engineer - Datastage

MOURI Tech Foundation

Website: mourifoundation.org
Job details:
Description

Shift : 1 : 30 pm - 10 : 30 pm IST

Login from Office : Tuesday - Sunday working

Job Description

We are seeking a highly skilled L3 support engineer with DataStage expertise. Who can perform as an individual contributor.

Key Responsibilities

• Develop robust and scalable data pipelines and workflows on azure with technologies like Data bricks, Spark, and Python.
• Designing and implementing highly performant data pipelines from multiple sources using Apache Spark and/or Azure Databricks.
• Integrating the end-to-end data pipeline to take data from source systems to target data repositories ensuring the quality and consistency of data is always maintained.
• Develop and maintain Python scripts for data processing, transformation, and automation with spark.
• Direct experience of building data pipelines using Apache Spark in Databricks.
• Utilize Python libraries and frameworks for efficient data manipulation.
• Proven experience working with SQL Server Integration Services (SSIS)/Data stage ETL tool with SQL Server Management Studio (SSMS).
• Proficiency in SQL programming, T-SQL, stored procedures, and database querying.
• Strong understanding of data warehousing concepts, ETL best practices, and database administration.
• Expert in DataStage solution conception, design, and deployment.
• Outstanding analytical & problem-solving abilities.
• Experience in optimizing and tuning ETL processes and SQL queries for performance.
• Strong understanding of data modeling and transformation techniques and Excellent problem-solving skills with the ability to analyze complex data and database-related issues.
• Strong communication and collaboration skills to work effectively with cross-functional teams and stakeholders.
  
  

Roles And Responsibilities

• Proven experience as a Data Engineer with a focus on Azure Databricks.
• Strong proficiency in Python/Spark programming for data processing and automation.
• Experience with Azure data services.
• Knowledge of data modeling and database design principles.
• Hands-on experience with Data stage ETL processes and data integration.
• Optimize existing DataStage jobs for performance. Reviewing job designs and code created by other DataStage developers. Troubleshoot DataStage job failures and provide root cause analysis.
• Monitor DataStage/SSIS job execution and troubleshoot issues as needed.
• Familiarity with big data technologies and distributed computing.
• Understanding of data governance, quality, and security practices.
• Excellent problem-solving and analytical skills.
• Strong communication and collaboration skills.
  
  

(ref:hirist.tech) Click on Apply to know more.