Data Scientist - AI Evaluation & Benchmarking Manager

Data Scientist - AI Evaluation & Benchmarking Manager

T00:00:00

Leeds

West Yorkshire

GB

LS1 3

Any

T11:39:24

About The Role

You'll join our AI Research team as a Data Scientist - AI Evaluation & Benchmarking Manager, helping to shape and evolve the model benchmarking and experimentation capabilities that underpin AI delivery across PwC and our clients. You'll work within a highly collaborative applied research environment that values curiosity, technical rigour and practical problem solving. In this role, you'll develop frameworks and experimentation workflows used to evaluate emerging AI models, driving evidence-based decisions for client engagements. We're looking for someone who enjoys technical ownership, thrives in fastmoving environments and is motivated by building scalable, secure AI research infrastructure.

You'll join our AI Research team as a Data Scientist - AI Evaluation & Benchmarking Manager, helping to shape and evolve the model benchmarking and experimentation capabilities that underpin AI delivery across PwC and our clients. You'll work within a highly collaborative applied research environment that values curiosity, technical rigour and practical problem solving. In this role, you'll develop frameworks and experimentation workflows used to evaluate emerging AI models, driving evidence-based decisions for client engagements. We're looking for someone who enjoys technical ownership, thrives in fastmoving environments and is motivated by building scalable, secure AI research infrastructure.

What Your Days Will Look Like

• You’ll play a key role in building and evolving our AI benchmarking and experimentation platforms, enabling robust and repeatable model evaluation.
• Your work will directly influence AI model selection and technical strategy across PwC projects and client engagements.
• Design and run end to end benchmarking workflows, from understanding client use cases, designing and running benchmarking strategies, and generating business ready insights
• Build scalable evaluation frameworks, metrics and pipelines, combining hands‑on engineering with continuous review of academic literature to ensure our evaluation strategies reflect leading research and best practice.
• Develop, maintain and improve experimentation infrastructure, ensuring robustness and production grade engineering.
• Produce clear, client ready insights and support technical demos and deep dive sessions.

This Role Is For You If

• You have strong hands‑on experience in Data Science concepts, or LLM experimentation using structured evaluation frameworks.
• You are highly proficient in Python, including asynchronous programming, multithreading and writing maintainable code.
• You have experience deploying ML workloads to cloud platforms (Azure, AWS or GCP), with familiarity in CI/CD and containerisation (Docker/ Podman).
• You have applied knowledge of statistics and experimental design and can translate findings into actionable recommendations.
• You are comfortable managing fastmoving workstreams and operating autonomously.
• You demonstrate emerging leadership behaviours - taking initiative, influencing technical direction, communicating clearly and supporting the development of others.
• You are motivated by ownership and excited by the opportunity to shape AI research platforms that directly impact client engagements.

What You'll Receive From Us

No matter where you may be in your career or personal life, our benefits are designed to add value and support, recognising and rewarding you fairly for your contributions.

We offer a range of benefits including empowered flexibility and a working week split between office, home and client site; private medical cover and 24/7 access to a qualified virtual GP; six volunteering days a year and much more.

• empowered flexibility and a working week split between office, home and client site
• private medical cover and 24/7 access to a qualified virtual GP
• six volunteering days a year and much more

#J-18808-Ljbffr

#s1-Gen

#J-18808-Ljbffr

Full job description from WhatJobs. Apply for this role →