- Design and run end-to-end benchmarking workflows from understanding client use cases through generating business-ready insights
- Build scalable evaluation frameworks, metrics and pipelines
- Review academic literature to ensure evaluation strategies reflect leading research and best practice
- Develop, maintain and improve experimentation infrastructure
- Ensure robustness and production-grade engineering
- Produce clear, client-ready insights
- Support technical demos and deep-dive sessions
- Influence AI model selection and technical strategy across PwC projects and client engagements
Requirements
- Strong hands-on experience in Data Science concepts or LLM experimentation using structured evaluation frameworks
- Highly proficient in Python, including asynchronous programming, multithreading and writing maintainable code
- Experience deploying ML workloads to cloud platforms (Azure, AWS or GCP)
- Familiarity with CI/CD and containerisation (Docker/ Podman)
- Applied knowledge of statistics and experimental design
- Ability to translate findings into actionable recommendations
- Comfortable managing fastmoving workstreams and operating autonomously
- Emerging leadership behaviours, including taking initiative, influencing technical direction, communicating clearly and supporting the development of others
- Available for work visa sponsorship
- Up to 20% travel
Core Competencies
Demonstrates expertise in Data Science concepts and LLM experimentation, with a strong focus on building scalable evaluation frameworks and deploying ML workloads on cloud platforms. Proficient in Python and capable of translating complex findings into actionable insights while managing fast-paced workstreams.
Highest-signal resume keywords
- Data Science Concepts
- Python Programming
- ML Workload Deployment
- CI/CD and Containerisation
- Experimental Design
ATS Optimization Keywords
Hard Skills
- Data Science
- LLM Experimentation
- Python
- Asynchronous Programming
- Multithreading
- ML Workload Deployment
- Statistics
- Experimental Design
Soft Skills
- Clear Communication
- Initiative
- Influencing Technical Direction
- Supporting Development of Others
Industry Keywords
- Benchmarking Workflows
- Evaluation Frameworks
- Client-Ready Insights
- Technical Demos
- Robustness
Tools & Technologies
- Azure
- AWS
- GCP
- Docker
- Podman
#J-18808-Ljbffr
Data Scientist – AI Evaluation & Benchmarking Manager in Manchester employer: Jobtailor
As a Client Services Coordinator at our dynamic company, you will thrive in a supportive work culture that prioritises employee growth and development. We offer comprehensive training, opportunities for advancement, and a collaborative environment where your contributions are valued. Located in a vibrant area, our team enjoys a healthy work-life balance and the chance to engage with diverse clients, making every day rewarding and meaningful.
