Website:
scoutit.in
Job details:
We're looking for
Associate Data Engineers!
Responsibilities
- Design, build, and maintain data pipelines (batch & streaming) in a cloud-native environment for ingestion, transformation, and processing of large-scale datasets
- Develop robust ETL/ELT processes using modern frameworks to support analytics and business intelligence use cases
- Partner with product teams to:
- Assemble complex data sets that meet both functional and non-functional requirements
- Create Data Dictionaries, Data Catalogs, and documentation for metrics, KPIs, and data assets
- Design and maintain data warehouses, data marts, and aggregations that enable insights into product performance, customer behavior, retention, and marketing effectiveness
- Implement and maintain real-time dashboards and alerting systems for data monitoring and operational visibility
Qualifications
- Proficient in SQL and data warehouse design concepts, including DataMart modeling
- Programming experience with Python, PySpark, or similar data languages
- Familiarity developing and maintaining data pipelines in cloud or hybrid environments
- Familiarity with at least one major cloud provider: GCP, AWS, or Azure
- Familiarity working with relational and NoSQL databases (e.g., Postgres, MongoDB)
- Familiarity with workflow orchestration tools such as:
- Apache Airflow
- Google Cloud Composer
- AWS Data Pipeline
- Familiarity using Git, Azure DevOps, or similar for version control and CI/CD
- Familiarity with Docker and Kubernetes:
- Building and deploying containers
- Creating pods, config maps, and deployments using Terraform
- Familiarity with Big Data and Data Engineering
- Strong analytical, problem-solving, and communication skills
- Ability to translate business requirements into technical documentation and data solutions
- Bachelor's degree in Computer Science, Information Systems, or a related engineering discipline
- Exposure to Business Intelligence tools: Tableau, Power BI, Dundas, etc.
(*Note: This is a requirement for one of Scout's clients)
Skills: data,azure,aws
Click on Apply to know more.