Virtusa
Website:
virtusa.com
Job details:
Data Engineer with Airflow
Location: Chennai / Hyderabad / Bangalore
Years of Experience: 5-7 Years
Job Summary: We are seeking a skilled Software Development Engineer with strong experience in Apache Airflow and proficiency in Python. The ideal candidate will have a solid understanding of ETL/ELT concepts and data pipeline architecture, along with experience in SQL and relational databases. Familiarity with cloud platforms, particularly Amazon Web Services, is essential. This role requires a detail-oriented individual who can design and implement robust data solutions.
Responsibilities
- Design, develop, and maintain data pipelines using Apache Airflow.
- Implement ETL/ELT processes to ensure efficient data flow and transformation.
- Collaborate with data engineers and analysts to optimize data architecture.
- Write and optimize SQL queries for data retrieval and manipulation.
- Deploy and manage data solutions on cloud platforms, primarily AWS.
- Ensure data quality and integrity throughout the data lifecycle.
- Document processes and maintain technical specifications.
- Strong experience with Apache Airflow.
- Proficiency in Python programming.
- Solid understanding of ETL/ELT concepts and data pipeline architecture.
- Experience with SQL and relational databases.
- Familiarity with Amazon Web Services (AWS).
- Experience with Snowflake is a deal breaker.
Preferred Skills
- Knowledge of data warehousing concepts.
- Experience with data visualization tools.
- Familiarity with containerization technologies (e.g., Docker).
Qualifications
- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 5-7 years of relevant experience in software development and data engineering.
- Strong analytical and problem-solving skills.
- Excellent communication and teamwork abilities.
Click on Apply to know more.