At a Glance
- Tasks: Lead AI safety and validation engineering, ensuring reliable and secure AI solutions.
- Company: Join a leading bank in Abu Dhabi with a focus on innovation.
- Benefits: Tax-free salary of 45k-50k AED, relocation support, and comprehensive benefits.
- Other info: Dynamic role with opportunities for professional growth in a collaborative environment.
- Why this job: Make a real impact in AI safety while working with cutting-edge technology.
- Qualifications: 7+ years in Machine Learning or AI Safety, strong Python skills, and leadership experience.
The predicted salary is between 90000 - 110000 £ per year.
We are hiring a Senior Manager of AI Safety and Validation Engineering to join a leading bank in their Group Business Services division. This is primarily a technical practitioner role focused on the design and implementation of technical measures to ensure the reliability and security of advanced AI solutions. You will bridge the gap between cutting edge AI development and rigorous risk standards while serving as a technical liaison to second line risk functions.
As a Senior Manager of AI Safety and Validation Engineering, you will lead the creation of evaluation frameworks for both predictive Machine Learning and Generative AI. You will be responsible for defining standardised monitoring protocols and automated guardrails. Working as an individual contributor, you will provide hands-on execution support to various product teams to ensure all deployments meet high performance and compliance standards.
Responsibilities:
- Define standardised evaluation rubrics and scoring systems for system performance and safety across various AI archetypes including RAG and agentic workflows.
- Design comprehensive test cases covering deterministic logic and adversarial scenarios to stress test AI outputs.
- Implement automated evaluators such as LLM-as-a-judge and targeted small language models.
- Deploy explainability techniques like Shapley Values and Integrated Gradients to ensure model transparency and unfair bias detection in lending and fraud models.
- Partner with platform teams to build telemetry pipelines that capture embeddings and inputs while maintaining strict data privacy standards.
- Establish golden signals such as hallucination rates and semantic similarity to trigger automated circuit breakers when performance thresholds are breached.
- Analyse guardrail violations to identify emerging attack patterns and integrate human-in-the-loop corrections into model refinement cycles.
- Translate technical telemetry into actionable model health reports for second-line risk functions.
- Work with specialist software vendors to bring advanced safety capabilities into the internal AI ecosystem.
Requirements:
- 7+ years of experience in Machine Learning Engineering, Data Science, or AI Safety and Testing.
- Bachelor's Degree in Computer Science, Information Technology, or a related engineering discipline.
- Expert proficiency in Python and deep knowledge of statistical testing and XAI libraries.
- Hands-on experience with LLM evaluation frameworks such as Ragas, Giskard, or Arize.
- Proven ability to design observability and monitoring systems at scale.
- Prior experience in the financial sector is highly preferred.
- Strong leadership skills with the ability to act as a technical mentor across cross-functional initiatives.
Senior Manager of AI Safety and Validation Engineering - Based in Abu Dhabi in London employer: Discovered MENA
Join a leading bank in Abu Dhabi as a Senior Manager of AI Safety and Validation Engineering, where you will be part of a dynamic team dedicated to pioneering AI solutions in a supportive and innovative work environment. Enjoy a competitive tax-free salary, comprehensive relocation benefits, and ample opportunities for professional growth in a culture that values collaboration and technical excellence. This role not only offers the chance to work at the forefront of AI technology but also provides a unique opportunity to influence risk management practices within the financial sector.
StudySmarter Expert Advice🤫
We think this is how you could land Senior Manager of AI Safety and Validation Engineering - Based in Abu Dhabi in London
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with people on LinkedIn. You never know who might have the inside scoop on job openings or can put in a good word for you.
✨Tip Number 2
Prepare for interviews by practising common questions and scenarios related to AI safety and validation. We recommend doing mock interviews with friends or using online platforms to get comfortable with your responses.
✨Tip Number 3
Showcase your expertise! Create a portfolio that highlights your projects in AI safety and validation engineering. This could include case studies, code samples, or even blog posts about your insights in the field.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search!
We think you need these skills to ace Senior Manager of AI Safety and Validation Engineering - Based in Abu Dhabi in London
Some tips for your application 🫡
Tailor Your CV:Make sure your CV is tailored to the role of Senior Manager of AI Safety and Validation Engineering. Highlight your experience in Machine Learning Engineering and any relevant projects that showcase your skills in AI safety and testing.
Craft a Compelling Cover Letter:Your cover letter should tell us why you're the perfect fit for this role. Share specific examples of how you've designed evaluation frameworks or implemented monitoring protocols in previous positions. Make it personal and engaging!
Showcase Your Technical Skills:Don’t forget to highlight your technical prowess! Mention your expertise in Python, statistical testing, and any hands-on experience with LLM evaluation frameworks. We want to see how you can bring value to our team.
Apply Through Our Website:We encourage you to apply through our website for a smoother application process. It’s the best way for us to receive your application and ensure it gets the attention it deserves!
How to prepare for a job interview at Discovered MENA
✨Know Your AI Stuff
Make sure you brush up on your knowledge of AI safety and validation engineering. Be ready to discuss specific frameworks like Ragas or Giskard, and how you've applied them in past roles. This shows you're not just familiar with the theory but have practical experience too.
✨Showcase Your Leadership Skills
As a Senior Manager, you'll need to demonstrate strong leadership abilities. Prepare examples of how you've mentored teams or led cross-functional initiatives. Highlight situations where your guidance made a significant impact on project outcomes.
✨Prepare for Technical Questions
Expect in-depth technical questions about Python, statistical testing, and XAI libraries. Practice explaining complex concepts in simple terms, as you may need to communicate these ideas to non-technical stakeholders.
✨Understand the Financial Sector
Since prior experience in the financial sector is preferred, do your homework on how AI is being used in banking. Be ready to discuss any relevant projects or insights you have that relate to compliance and risk management in this industry.
