Data Engineer

Design and implement software solutions using database technologies in big data environments and develop data driven, analytical applications. Design, develop, and maintain ETL/ELT processes and Azure Data Factories to transform data. Use advanced software patterns and designs to code and implement data pipelines and setup systems. Develop scripts, tools, and methodologies for streamlining and automation modeling practices. Work with DBAs to monitor SQL query performance and optimize low performing SQL queries. Coordinate with cross-functional operational teams for managing delivery and deployment of database solutions. Troubleshoot and resolve data-related software production issues and analyze existing systems to provide recommendations for improvement. Monitor system performance, perform predictive maintenance, and perform system risk and reliability analysis. Assess new technologies before adoption and implementation. Work with operations to understand data needs and requirements and adopt Agile methodologies to develop and release software. Participate in project planning meetings to help prioritize various features, determine feasibility and complexity of features, and provide timelines for completion of these features. Create use-cases and scenarios for functional, integration, and system testing. Participate in code review and optimization sessions with the development teams. Coordinate with cross-functional operational teams for managing delivery and deployment of software solutions, and work with global distributed teams. Provide guidance and support on various database architecture and design areas in data modeling and ETL/ELT solutions. Mentor data engineers. Technical Environment: Database technologies (Oracle, MySQL, PostgreSQL, SQL Server, Cosmos DB); Azure SQL; cloud based on-premises solutions; data modeling, ETL processes; Stored procedures, Functions, Triggers, Views and jobs; SQL; cloud based ETL and data integration services (Azure Data Factories (ADF)), pipelines on Azure Cloud; Unix, Unix Shell Scripting & Cron Job to generate flat files & scheduling jobs; Web API for interfaces; Web API for Web Scraping.

Specializes in data engineering and software solutions.