Data Engineer

Warwick Source: WhatJobs

See advert for pay

Overview

In this role you will design and maintain data products and analytics pipelines that support business outcomes across core applications and data platforms. You will enable decentralised data ownership and govern data quality to improve visibility and performance metrics. You will build dashboards and APIs, collaborate with stakeholders, and advance data mesh and federated governance in a large-scale utility context. This is a hybrid role based in Warwick, offering impactful work on data-driven transformation.

Pay / Benefits

hybrid working
flexible working arrangements
inclusive workplace
support for adjustments during recruitment process
opportunities to impact energy transition
professional development opportunities

Responsibilities

Develop and maintain ETL pipelines and data models for analytics and reporting platforms
Design, build, and maintain data products serving specific business domains and use cases
Conduct advanced data mining and manipulation, advising on architecture and data model changes
Design and deliver Power BI dashboards and reports for stakeholders
Set roadmaps for information quality and ensure data dependencies are governed
Collaborate with business users to catalogue data lineage and develop data quality dashboards
Ensure data consistency through cleaning, transformation, and validation
Support data scientists and analysts by delivering robust data solutions
Build and maintain APIs for secure, scalable data exchange across systems
Develop and optimise data pipelines using Snowflake and big data tools (Databricks, Trino)
Contribute to data mesh principles and federated governance
Leverage Data Fabric platforms (Promethium) to unify data access, discovery, governance
Integrate and orchestrate data flows using MuleSoft and SnapLogic

Key requirements

Strong experience in data mining, profiling, and manipulation of large datasets
Proficiency in writing ETL code and implementing data quality rules
Advanced Power BI skills (DAX, Power Query, data modelling, report design)
Skilled in Python, SQL, Azure Data Factory, Git, and DBT
Experience with Snowflake and big data tooling (Databricks, Trino)
Strong API development and testing experience
Proficient in deploying and managing data infrastructure in Microsoft Azure (Azure Data Lake, Synapse, Functions)
Familiarity with data mesh concepts (data as a product, domain ownership, federated governance)
Experience in data governance including stewardship, policy implementation, and metadata management
Knowledge of JIRA and agile delivery practices
Effective communicator capable of translating complex data issues to diverse audiences