Data Engineer

Data Engineer - Python / PySpark / Microsoft Fabric

£55,000 - £65,000 + Benefits

St Helens - 1-2 days per week

This is an opportunity to join an organisation at a particularly interesting point in the development of its data capability.

The business has invested heavily in modernising a sizeable legacy data estate, moving away from traditional SQL-based platforms and establishing a modern Microsoft Fabric/Azure data environment.

The foundations are now in place.

The next stage is about building on them.

As the Data Engineer, you'll join a growing team responsible for developing the pipelines, transformations and data products that sit on top of the new platform.

Importantly, this isn't a traditional Azure Data Engineer role dominated by ADF, stored procedures and drag-and-drop development.

The team is deliberately moving towards a more code-led engineering approach, with a strong emphasis on Python, PySpark and notebook-based development.

What you’ll be working with

The environment includes:

• Python / PySpark
• Microsoft Fabric
• Spark and notebook development
• Lakehouse architecture
• Medallion / Bronze, Silver & Gold patterns
• Delta tables
• SQL
• Azure
• Git / source control
• CI/CD
• Testing, monitoring and data quality

Experience with Azure Databricks is particularly relevant and transfers well into what the team is building within Fabric.

You don't necessarily need commercial Fabric experience if you've worked in a modern Databricks/Spark/Python engineering environment.

Equally, we're open to strong Python Data Engineers who have built production-grade data solutions through code and are looking to move deeper into PySpark, distributed processing and Fabric.

What makes this different?

The business isn't simply replacing one data warehouse with another.

With the core modernisation underway, attention is moving towards how the organisation uses its data, including more sophisticated data products, automation, AI and Generative AI.

That creates an opportunity to join while there's still a significant amount to build, improve and influence.

We're looking for somebody who enjoys engineering - someone who would rather write code, solve problems and build something properly than spend their career connecting boxes together in a UI.

Salary: £55,000 - £65,000

Hybrid: 1-2 days per week in the St Helens

#J-18808-Ljbffr

Full job description from WhatJobs. Apply for this role →