Website:
scoutit.in
Job details:
We're looking for
Data Engineers!
Responsibilities
- Design, build, and maintain scalable data pipelines for processing structured and unstructured data
- Develop and optimize ETL/ELT workflows to support analytics and AI/ML use cases
- Integrate data from multiple sources including APIs, databases, and cloud storage systems
- Prepare and transform data for machine learning models, especially NLP-based applications
- Implement data quality checks, monitoring, and logging mechanisms
- Ensure data security, privacy, and compliance with industry standards
- Optimize performance and cost of data processing systems
- Participate in Agile development, code reviews, and documentation
Qualifications
- Prior experience in banking domain is plus and understanding the finance various data transactions.
Should Be Strong In The Below
- Python
- Pyspark
- SQL
- Airflow
- Trino
- Hive
- Offshore Cordination
- LLD
- Agile Scrum
- Linux
- Openshift
- Kubernentes
- Superset
Optional Skill Set
- Linux
- Openshift
- Kubernentes
- Superset
(*Note: This is a requirement for one of Scoutit's clients)
Skills: python,sql,linux
Click on Apply to know more.