Willware Technologies
Website:
willwaretech.com
Job details:
Role: ETL Data Engineer
Experience: 6+Years
Location: Bangalore
Work Mode: Onsite
Key Responsibilities:
• Collaborate with business users and analysts to understand data requirements and deliver scalable data engineering solutions on AWS.
• Design, develop, and optimize ETL pipelines using AWS Glue, Lambda, EMR, Kinesis and Step Functions to process large volumes of structured and semi-structured data.
• Build and manage data lake and data warehouse solutions on Amazon S3 and Redshift.
• Write, test, and maintain SQL queries, stored procedures, and data transformation logic for efficient data processing.
• Utilize Athena, Redshift Spectrum, and Glue Data Catalog to enable self-service analytics and reporting.
• Implement data ingestion workflows from diverse sources including RDBMS, APIs, and flat files.
• Design scalable data models (Star and Snowflake schemas) and ensure adherence to best practices in data architecture.
• Conduct data profiling, perform root cause analysis, and resolve data quality and performance issues.
• Maintain comprehensive documentation including data dictionaries, data flow diagrams, and field-level mappings.
• Support production data pipelines and provide troubleshooting during outages or failures.
• Monitor and optimize data pipeline performance, cost, and reliability across AWS services.
Required Skills & Qualifications:
• 6+ years of experience in data engineering, ETL development, and data warehousing.
• Strong hands-on experience with AWS data services.
• Proficient in SQL, with experience in relational databases like SQL Server, Oracle, and cloud-native platforms.
• Solid understanding of data modeling techniques (Star/Snowflake schemas).
• Experience in ingesting and transforming data from varied sources including files, APIs, and databases.
• Strong analytical and problem-solving skills with the ability to debug data and performance issues.
• Ability to engage directly with business users and translate requirements into technical solutions.
• Capable of managing multiple projects and priorities in a fast-paced environment.
• Excellent written and verbal communication skills."
Click on Apply to know more.