UST
Website:
ust.com
Job details:
Role Description
Data Engineer
Experience: 5–10 Years
Job Summary
We are seeking an experienced Data Engineer with strong expertise in Python-based application development, data processing, and cloud-based data platforms. The ideal candidate will have hands-on experience with Azure services, Databricks, and building scalable ETL pipelines.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines and ETL processes using Python
- Build and optimize data workflows using Databricks and PySpark
- Develop APIs and backend services using Flask (preferred) or FastAPI
- Integrate Python applications with Azure services (e.g., Azure Storage, Azure SQL, Azure Data Factory)
- Work with large datasets to perform data transformation, cleansing, and aggregation
- Collaborate with cross-functional teams to understand data requirements and deliver solutions
- Ensure data quality, integrity, and performance optimization across systems
- Deploy and monitor data solutions in cloud environments
Required Skills
- Strong proficiency in Python for application development
- Hands-on experience with Flask (preferred) or FastAPI for API development
- Solid experience in data processing and ETL development using Python
- Strong knowledge of Databricks and PySpark (Databricks preferred)
- Experience integrating Python applications with Azure services
- Good understanding of REST APIs and backend development
- Experience working with structured and unstructured data
Preferred / Additional Skills
- Experience with Azure Data Pipelines / Azure Data Factory
- Knowledge of AI/ML integration within data pipelines or applications
- Familiarity with CI/CD pipelines and DevOps practices
- Experience with cloud data architecture and distributed systems
Skills
data engineering,python,api development,flask,application development,
Click on Apply to know more.