Flag job

Report

Data Engineer - AWS

Min Experience

3 years

Location

remote

JobType

Full Time

About the job

Info This job is sourced from a job board

About the role

• Addepto is a leading consulting and technology company specializing in AI and Big Data, helping clients deliver innovative data projects. • You will work with a team of technology experts on challenging projects across various industries, leveraging cutting-edge technologies. • Design and development of a universal data platform for global aerospace companies. • Development and maintenance of a large platform for processing automotive data. • Design of the data transformation and following data ops pipelines for global car manufacturer. • Key tasks include data cleaning, normalization, and optimizing data model for performance and accuracy. • Build and scale reliable data pipelines for both real-time and batch processing, using technologies like Airflow and AWS Step Functions. • Develop automated data workflows that power analytics, reporting, and AI/ML models. • Work with diverse data sources, ensuring consistent quality, integrity, and readiness for analysis across platforms. • Partner closely with data science and business teams to align technical solutions with real-world use cases. • Contribute to MLOps and CI/CD pipelines, helping streamline the deployment and monitoring of data products and models. • Continuously evaluate and improve existing processes for speed, efficiency, and scalability in a cloud environment. • Turn business problems into data-driven solutions, ensuring high performance, security, and scalability.

About the company

Addepto is a company specializing in Artificial Intelligence and Machine Learning solutions tailored for various industries. They offer AI consulting, MLOps consulting, and data engineering services, providing comprehensive AI-driven strategies and applications. Addepto focuses on implementing sophisticated AI technologies such as Generative AI, computer vision, and large language models to solve complex business problems. They cater to industries like finance, aviation, retail, and logistics, among others, enhancing operations and decision-making processes.

Skills

Airflow
Amazon Redshift
AWS
Azure
Cloud
Hadoop
Python
Spark
SQL
Unix