Website:
blackpiano.co.uk
Job details:
Role Overview
The engineer will be working within an established Microsoft Fabric data platform, supporting the delivery of a large number of data transformation workflows.
The platform is already built - the focus is on high-quality, fast execution of flow-specific development within an existing architecture.
This role suits mid-level engineers who are hands-on, productive, and able to work independently as part of a wider team.
Core Technical Requirements (Must-Have)
- PySpark – essential
- Microsoft Fabric and/or Databricks (hands-on, production use)
- Notebook-based development (Fabric / Synapse / Databricks)
- Strong data pipeline development experience (ETL / ELT)
- Experience working within Medallion architecture (Bronze / Silver / Gold)
- Understanding of good coding practices (readability, structure, maintainability)
- Azure ecosystem experience preferred
Experience & Profile
- 2–5 years’ experience (mid-level)
- Able to work independently on defined user stories
- Comfortable working as part of a collaborative delivery team
- Not looking for architects or junior profiles
- Energy/utilities / MHHS experience – nice to have
Scope of Work
- Deliver PySpark-based development against defined requirements
- Work within an existing Fabric-based architecture
- Amend and extend existing pipelines (not building from scratch)
- Support optimisation, fixes, and enhancements
- Contribute to data transformation logic for multiple data flows
- Support export of data to downstream systems
Ways of Working
- Highly collaborative and interactive role
- Regular engagement with internal stakeholders (technical and business)
- Strong communication skills required
- Working full-time in UK hours
Click on Apply to know more.