Aventra Group
Website:
aventragroup.com
Job details:
We are seeking an experienced Senior Data Engineer to design, develop, and optimize modern enterprise data platforms leveraging Microsoft Fabric, Azure Cosmos DB, Star Schema, and Data Vault 2.0 methodologies. The ideal candidate will have a strong background in cloud data architecture, data modeling, ETL/ELT development, and large-scale analytics platforms. This role requires hands-on expertise in building scalable, high-performance data solutions that support business intelligence, AI/ML, and operational reporting.
Key ResponsibilitiesData Platform Engineering
- Design, develop, and maintain enterprise-grade data platforms using Microsoft Fabric.
- Build scalable Lakehouse, Data Warehouse, and Real-Time Analytics solutions within Microsoft Fabric.
- Develop robust and efficient data pipelines using Fabric Data Factory, Spark Notebooks, and Dataflows.
- Implement monitoring, performance tuning, and platform optimization strategies.
Data Modeling & Architecture
- Design and implement Data Vault 2.0 models including Hubs, Links, and Satellites for enterprise data warehousing.
- Develop dimensional models using Star Schema for reporting, analytics, and Power BI consumption.
- Ensure adherence to data governance, metadata management, and data quality standards.
- Collaborate with business stakeholders to translate requirements into scalable data models.
Azure Cosmos DB Engineering
- Design, develop, and optimize solutions leveraging Azure Cosmos DB.
- Implement data ingestion, transformation, and synchronization processes between Cosmos DB and Fabric.
- Optimize partitioning strategies, indexing policies, and query performance.
- Support high-volume transactional and analytical workloads.
Data Integration & ETL/ELT
- Develop end-to-end ELT/ETL pipelines integrating data from multiple enterprise systems.
- Work with structured, semi-structured, and unstructured datasets.
- Implement incremental loading, CDC (Change Data Capture), and near real-time processing patterns.
- Ensure data reconciliation, validation, and quality controls.
Performance & Governance
- Establish best practices for scalability, reliability, security, and maintainability.
- Implement CI/CD pipelines for data engineering workloads.
- Support data governance initiatives including lineage, cataloging, and compliance requirements.
- Conduct code reviews and mentor junior data engineers.
Required QualificationsEducation
- Bachelor's degree in Computer Science, Information Technology, Engineering, or related field.
- Master's degree is an advantage.
Experience
- 5-8 years of experience in Data Engineering.
- Minimum 2+ years of hands-on experience with Microsoft Fabric.
- Strong experience implementing enterprise Data Warehousing solutions.
- Proven experience working with Azure Cosmos DB.
- Experience designing and implementing Data Vault 2.0 architectures.
- Strong expertise in Star Schema and dimensional modeling.
Technical SkillsMust Have
- Microsoft Fabric
- Fabric Data Factory
- Lakehouse
- Data Warehouse
- OneLake
- Spark Notebooks
- Real-Time Analytics
- Azure Cosmos DB
- Data Vault 2.0
- Star Schema & Dimensional Modeling
- SQL (Advanced)
- PySpark
- Python
- Azure Data Services
- Git & CI/CD
- Power BI Integration
- ETL/ELT Frameworks
Preferred
- Azure Synapse Analytics
- Azure Databricks
- Event Streaming / Kafka
- Delta Lake
- Azure DevOps
- Terraform / Infrastructure as Code
- AI/ML Data Platform experience
Key Competencies
- Strong analytical and problem-solving skills.
- Data architecture and solution design expertise.
- Ability to work independently and lead technical initiatives.
- Excellent stakeholder management and communication skills.
- Experience mentoring and guiding junior engineers.
- Strong understanding of enterprise data governance and best practices.
Success Measures
- Delivery of scalable and performant Fabric-based data solutions.
- Adoption of Data Vault 2.0 and Star Schema best practices.
- Improved data quality, reliability, and accessibility.
- Efficient management of Cosmos DB workloads and integrations.
- Successful enablement of analytics, reporting, and AI initiatives.
Nice-to-Have Certifications
- Microsoft Certified: Fabric Analytics Engineer Associate
- Microsoft Certified: Azure Data Engineer Associate
- Microsoft Certified: Azure Solutions Architect Expert
- DP-600, DP-203, AZ-305
Click on Apply to know more.
