Data Engineer

Our client, a leading organisation within the technology sector, is seeking a Data Engineer to join its team on a permanent basis. The role will focus on designing and maintaining scalable Azure data platforms, developing robust data pipelines and supporting data-driven solutions across the business.

Key Responsibilities:

• Design, develop and maintain scalable data pipelines and integration solutions using Azure.
• Build and optimise ETL and ELT processes with Azure Data Factory, Databricks and Synapse Analytics.
• Manage and enhance data lakes, data warehouses and storage solutions, including Azure Data Lake Storage.
• Develop and optimise SQL queries, data models and database objects for performance and scalability.
• Ensure data quality, security, governance and compliance with organisational standards.
• Implement CI/CD practices and support deployment automation through Azure DevOps or GitHub.
• Monitor, troubleshoot and resolve data platform and pipeline issues.
• Collaborate with stakeholders, analysts and developers while maintaining technical documentation, data dictionaries and operational procedures.

Job Requirements:

• Experience in Data Engineering, database development or data integration, with hands‑on knowledge of Microsoft Azure data services.
• Strong experience with Azure Data Factory, Azure Databricks, Azure Synapse Analytics and Azure Data Lake Storage.
• Advanced SQL development and performance tuning skills, including experience with Azure SQL Database and SQL Server.
• Proficiency in Python, PySpark, Scala and Spark for data processing and distributed computing.
• Understanding of data warehousing concepts, dimensional modelling and ETL/ELT frameworks.
• Knowledge of data quality, data governance, metadata management and data security principles.
• Experience with CI/CD pipelines using Azure DevOps or GitHub, along with an understanding of cloud architecture.
• A bachelor's degree in Computer Science, Information Technology, Data Engineering or a related discipline; Microsoft Azure certifications such as DP-203 or AZ-900 would be advantageous.

Desirable Skills:

• Experience with Microsoft Fabric and Azure Database services.
• Knowledge of big data technologies, streaming solutions and modern data architecture patterns.
• Relevant Microsoft certification, such as Azure Data Engineer Associate, Azure Fundamentals or Azure Database Administrator Associate.

Benefits:

• Permanent opportunity within a forward‑thinking technology environment.
• Access to professional development and Microsoft Azure training opportunities.
• Opportunity to work with modern cloud data platforms and large‑scale data solutions.
• Collaborative working environment with opportunities to contribute to continuous improvement initiatives.

#J-18808-Ljbffr

Full job description from WhatJobs. Apply for this role →