Data Engineer

Birmingham Source: WhatJobs
£65,000–£90,000

We are looking for an experienced Data Engineer to support a data migration and integration programme within a relatively low maturity Azure environment.

Key Skills & Experience

  • Azure Data Engineering
  • Azure Data Factory (ADF)
  • Azure Data Lake
  • Databricks
  • Building ETL / ELT pipelines
  • Large-scale data migration and integration
  • Oracle and/or Oracle Fusion data sources
  • SharePoint data extraction and integration
  • Working with multiple and varied source systems
  • Data transformation, mapping and validation
  • Designing data pipelines in environments where architecture and processes are still developing

Key Responsibilities

  • Design, build and maintain data migration and ingestion pipelines within Azure.
  • Support the setup and development of the Azure Data Lake environment.
  • Build integrations between source systems, Azure Data Lake and Databricks.
  • Develop and manage pipelines using Azure Data Factory (ADF).
  • Extract and migrate data from a variety of source systems, including:
  • Oracle
  • Oracle Fusion
  • Informatica
  • SharePoint, which will be an initial priority
  • Additional enterprise and legacy systems as the programme develops
  • Help define scalable data ingestion, transformation and migration patterns for future source systems.
  • Support data quality, validation and troubleshooting throughout the migration process.
  • Work closely with technical and business stakeholders to understand source data, target structures and transformation requirements.
  • Help improve the overall maturity of the Azure data environment, introducing appropriate engineering standards and best practices

#J-18808-Ljbffr

Full job description from WhatJobs. Apply for this role →

Back to all jobs

Help others hire with confidence

Reviews on Trustpilot

Worked with Verifera as a candidate or employer? Your honest review helps the next person trust verified hiring.