Data Platform Engineer

Are you a Data Platform Engineer wanting to join a business early on in their new data platform launch?

You'll have the genuine ability to make a real impact at this Housing Association, with the opportunity to help shape the direction of its data platform and a clear route to lead and architectural roles. If you're a Data Engineer with good technical grounding and now wanting to grow and learn, then this would be an excellent opportunity for you.

This is a hands-on data engineering role where you'll be building and shaping how data works across the organisation.

As Data Engineer, you'll spend your time designing and developing robust ingestion pipelines across Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS), pulling data from multiple source systems and turning it into something joined-up, usable, and genuinely valuable. You'll be working with a range of Dynamics, legacy and bespoke systems, APIs and public-domain data, bringing this information into the data platform and landing it into the Bronze layer within Databricks.

Alongside that, you'll be working in Databricks using Python, SQL and notebooks, supporting the development of a new Databricks environment and helping to build the foundations of a modern data platform. You'll work closely with the wider Data Engineering team, who will take data through the subsequent Silver and Gold layers, so collaboration and good communication will be important.

The business is very proud of its engineering culture and mindset. You'll be working with Git and CI/CD processes to deliver changes across environments, keeping things clean, controlled, and scalable as the platform grows. There will also be scope to get involved in the administration and development of the new Databricks environment, giving you the opportunity to have a genuine influence over how the platform is built.

This role sits right at the centre of how data is used, collaborating closely with BI analysts, Data Engineers and wider business teams to make sure data is accessible and actually drives decisions, not just reports, so you won't be working in isolation.

Ultimately, this is a role for someone who wants to move beyond just building pipelines and start shaping the future state for data in a modern, cloud-based environment. You'll be joining an organisation that wants to use data to make better decisions and ultimately improve the lives of its tenants and communities.

You would be an excellent fit as Data Engineer if you have:

• Designed, built, and managed ETL/ELT data ingestion pipelines using Azure Data Factory (ADF) and Azure Data Lake Storage (ADLS)
• Around 3-5 years' experience working with Databricks, with strong practical and competent experience
• Experience working with Python, SQL and Databricks notebooks
• Experience working with Databricks Bronze layer architecture and modern cloud-based data platforms
• Experience with Git and CI/CD processes such as Azure DevOps or GitHub
• Strong communication skills and the ability to work collaboratively with Data Engineering, BI and wider business teams

This is a hybrid role with one day a week in one of their office across the South East and East Midlands.

The salary is £55,000 with some flexibility depending on experience, alongside a good benefits package.

#J-18808-Ljbffr

Full job description from WhatJobs. Apply for this role →