Ingrain Systems Inc
Website:
ingrain.us
Job details:
Job title: Senior Data Engineer
Experience:3+yrs
Location: Hyderabad
Work type: Hybrid
Roles & Responsibilities:
• At least 3+yrs years of experience in application design, development and analysis
• Experience in AWS Cloud Solutions & GCP. Retail Industry experience preferred.
• Implement data transformations and data structures for data warehouse and lake/repository.
• Manage cloud and/or on-premises solutions for data transfer and storage.
• Process data using spark (PySpark)
• Manage cloud and/or on-premises solutions for data transfer and storage.
• Collaborate and work with data analysts in various functions to ensure that data meets their reporting and analysis needs.
• Experience in creating Various ETL Frameworks in processing or extracting the data from cloud databases by using AWS Services by leveraging Lambda, Glue, PySpark, Step Functions, SNS, SQS and Batch.
• Proven ability to be a strategic thinker to drive the necessary ownership and data governance within the organization
• Ability to evaluate risks and provide business recommendations / solutions in a timely manner
• Ability to remain calm in high stress situations while navigating and leading during times of conflict
• Should have sound knowledge in various AWS Services
• Able to understand the existing Frameworks built in AWS PySpark and Glue
• Able to scan ETL Frameworks and propose optimizations and cost savings.
• Able to work independently and able to take key decisions.
• Comfortable interacting with stakeholders at all levels through Business and IT.
• Ability to express complex concepts effectively, both verbally and in writing to IT & Business partners
• Understanding of and experience working in an Agile environment
• Knowledge on Talend Cloud ETL,Kafka, Snowflake Cloud and PowerBI is addon
• Independent. Strong critical thinking, decision making, troubleshooting and problem-solving skills.
Click on Apply to know more.