Flag job

Report

Principal Data Engineer

Min Experience

5 years

Location

Edinburgh, Witham

JobType

Full Time

About the job

Info This job is sourced from a job board

About the role

Principal Data Engineer Permanent Location: Edinburgh or Witham (We believe in the power of in-person collaboration, and our hybrid model requires colleagues to be in the office a minimum of 40% of their time.) This is an exciting opportunity for an experienced data engineer to join our growing team and play a key role in the delivery of our data strategy. In this role, you will be responsible for designing, building and maintaining robust and scalable data pipelines, as well as providing technical leadership and mentorship to more junior members of the team. You will work closely with data analysts, data scientists and business stakeholders to understand their requirements and translate them into effective data solutions. Key responsibilities: - Design and implement highly scalable and performant data pipelines to support our business intelligence, reporting and analytics needs - Automate and operationalize data ingestion, transformation and data quality processes - Collaborate with data scientists and analysts to build and deploy advanced analytics solutions - Mentor and coach more junior data engineers, sharing your expertise and best practices - Stay up to date with the latest data engineering trends and technologies and evaluate their applicability to our environment - Contribute to the continuous improvement of our data engineering practice, tools and standards Key requirements: - Substantial experience as a data engineer or big data engineer, with a proven track record of designing and delivering high-quality data pipelines - Expertise in designing, building and optimizing scalable data architectures using modern data engineering tools and frameworks (e.g. Spark, Kafka, Airflow, Databricks, AWS/Azure data services) - Strong programming skills, with proficiency in Python, Scala or other JVM-based languages - Excellent SQL skills and experience working with a variety of databases and data warehousing technologies - Experience with cloud data platforms (e.g. AWS, Azure, GCP) and a good understanding of cloud-native data services - Ability to effectively communicate technical concepts to both technical and non-technical stakeholders - A collaborative mindset and a desire to share knowledge and mentor more junior team members - Degree in Computer Science, Engineering or a related technical field

About the company

Finance, risk, project management, human resources and more — discover the exciting career opportunities at Aegon.

Skills

sql
python
scala