Algo8 AI
Website:
algo8.ai
Job details:
Job description
📢 We're Hiring
We're looking for a skilled and motivated Data Engineer to join our team! As a Data Engineer, you will be responsible for developing, constructing, testing, and maintaining architectures, such as databases and large-scale processing systems, to support our data processing needs.
💼Experience : 3 to 5 years
📍Location : Noida
🎓Qualification :
- Bachelor’s degree in one of the fields (most common) : Computer Science, Information Technology, Data Science, Software Engineering, Mathematics or Statistics
- Optional but beneficial: Master’s degree in Data Engineering, Data Science, or related fields.
✅Required Skills :
- Proficiency in SQL & Python for data processing, data manipulation, and scripting.
- Experience with big data technologies such as Spark, Kafka, Cloud tech stack etc.
- Experience with tools and best practices for developing and managing data engineering pipelines, data lakes and warehouses, such as ETL tools, job management and data management tools, especially open-source tools
- Strong understanding of database technologies (SQL, NoSQL) and data modelling and data base schema design principles.
- Experience with containerization (Docker, Kubernetes) is a plus.
Responsibilities :
- Develop, construct, test, and maintain architectures, such as databases and large-scale processing systems using Python.
- Design, develop, and maintain robust and scalable data pipelines for ingesting, processing, and transforming large volumes of data from various sources.
- Implement data integration solutions to extract, load, and transform data from disparate systems and databases.
- Develop and optimize ETL processes to cleanse, transform, and enrich raw data for analysis and reporting purposes.
- Ensure data quality and integrity throughout the ETL lifecycle through validation and error-handling mechanisms.
- Ensure architecture will support the requirements of the business.
- Collaborate with data scientists and analysts to understand data requirements and deliver solutions.
- Implement data security and privacy measures.
- Monitor and optimize performance of the data infrastructure.
🌐To know more about us: https://algo8.ai/
To drop your resume : shruti.sinha@algo8.ai
Interested candidate requested to fill the form on this link : https://forms.gle/Y2NkF6fwb35MXd6a9
Click on Apply to know more.