Senior Data Engineer – London-UK, Spain, Germany & Portugal
Remote
Role Overview
We are looking for a Senior Data Engineer with strong expertise in Python, SQL, Data Engineering, and AI/ML to design, build, and deliver scalable data and AI solutions.
The role involves owning technical workstreams end-to-end, contributing to Generative AI and Agentic AI solutions , and applying modern data engineering, MLOps, and LLMOps practices across enterprise environments.
Key Responsibilities
- Design, develop, and maintain scalable data engineering and AI solutions .
- Lead technical workstreams and mentor junior engineers while promoting strong software engineering practices.
- Build Generative AI, Agentic AI, Machine Learning, and Business Intelligence solutions .
- Work with technologies such as Spark, LangChain, Databricks, Dask, Airflow, Dagster, and Kedro .
- Develop AI capabilities using prompt engineering, RAG, embeddings, vector databases, and context engineering .
- Own AI feature delivery from development through production, including evaluation, reliability, guardrails, and performance optimisation .
- Implement data security and governance , including PII/PHI protection, authentication, and RBAC.
- Establish and maintain MLOps and LLMOps pipelines , including CI/CD and automated AI/agent evaluation.
- Use tools such as LangSmith, Opik, Langfuse, and Terraform across AWS, Azure, and GCP environments.
- Work effectively in polyglot enterprise environments involving Python, SQL, Scala, and Java .
- Independently manage technical deliverables, priorities, and timelines.
- Collaborate effectively with technical and business stakeholders.
- Travel occasionally when required.
Required Skills & Experience
- Degree in Computer Science, Engineering , or equivalent professional experience.
- 5+ years of relevant experience in Data Engineering.
- Strong experience leading technical initiatives, mentoring engineers, and driving engineering best practices.
- Expert-level Python and SQL skills.
- Hands-on experience with Generative AI, Agentic AI, Machine Learning, and BI solutions.
- Strong knowledge of RAG, embeddings, vector databases, prompt engineering, and context construction .
- Experience with modern frameworks and platforms such as Spark, Databricks, LangChain, Airflow, Dagster, Dask, or Kedro .
- Experience with MLOps/LLMOps, CI/CD, AI evaluation, and production AI systems .
- Knowledge of LangSmith, Opik, Langfuse , or similar AI evaluation/observability tools.
- Experience with Terraform and cloud environments such as AWS, Azure, and GCP .
- Understanding of data security, governance, PII/PHI, authentication, and RBAC .
- Strong English communication skills and proficiency in the relevant local language.
- Ability to work independently with strong ownership, organisation, and time-management skills .
Nice to Have
- Experience using AI coding assistants/agents such as Cursor, Claude Code, or Codex .
- Experience working with Scala and Java in enterprise environments.
- Willingness to travel when required.
Location: Spain, Germany or Portugal, UK
#J-18808-Ljbffr
Full job description from WhatJobs. Apply for this role →