Data Engineer

Experience: 2-3 Years of relevant Experience

Location: Bangalore

Remuneration:

Job Brief:

We are looking for a Data Engineer to join our team. You will use various methods to transform raw data into organised ETL.

You should have strong analytical skills and the ability to combine data from different sources. Data engineer skills also include familiarity with several programming languages and knowledge of learning machine method

Responsibilities:

• Data Modeling and Design:
• Design, develop, and maintain data architectures, data modeling, data storage, and data access solutions.
• Collaborate with cross-functional teams to understand data requirements and implement effective data solutions.
• ETL Development:
• Develop and implement robust ETL processes to extract, transform, and load data from various sources into our data warehouse.
• Optimize and tune ETL processes for performance and scalability.
• Data Integration:
• Integrate data from different sources and ensure data consistency and accuracy.
• Implement real-time and batch data integration solutions.
• Data Quality and Governance:
• Implement data quality checks and ensure data integrity throughout the data pipeline.
• Work on data governance and compliance initiatives to meet industry standards and regulations.
• Database Management:
• Manage and optimize databases to ensure efficient data storage and retrieval.
• Troubleshoot database-related issues and implement solutions.
• Collaboration and Documentation:
• Collaborate with data scientists, analysts, and other stakeholders to understand their data needs.
• Document data engineering processes, workflows, and best practices.

Qualifications:

• Bachelor's degree in Computer Science, Information Technology, or a related field.
• Proven experience as a Data Engineer with 2 to 3 years of hands-on experience.
• Strong proficiency in SQL and experience with relational databases (e.g., PostgreSQL, MySQL).
• Experience with ETL tools and frameworks (e.g., Apache NiFi, Apache Beam, Talend).
• Knowledge of big data technologies and frameworks (e.g., Hadoop, Spark) is a plus.
• Familiarity with cloud platforms (e.g., AWS, Azure, GCP) and their data services.
• Excellent problem-solving skills and attention to detail.
• Strong communication and collaboration skills.