At a Glance
- Tasks: Lead the design and architecture of next-gen AI systems while driving quality and scalability.
- Company: Join RWS, a global leader in AI solutions trusted by top brands.
- Benefits: Enjoy competitive pay, flexible work options, and opportunities for personal growth.
- Other info: Be part of a diverse team that values innovation and collaboration.
- Why this job: Shape the future of AI technology and make a real impact on global enterprises.
- Qualifications: 5+ years in software engineering with expertise in AI/ML systems and strong communication skills.
The Senior AI Engineer is an individual contributor who defines technical direction while driving the quality, scalability, and reliability of next-generation AI-powered systems. This role operates at the intersection of research, software engineering, and advanced testing, transforming cutting-edge ideas into robust, production-ready platforms. This is a senior individual contributor leadership role: the Senior AI Engineer operates as a force multiplier, shaping architecture and core platforms and frameworks, guiding teams, and also pioneering and designing research projects that are evaluated, presented, and then delivered at enterprise scale with high confidence.
About AI Platforms and Excellence
The AI Platforms and Excellence team aims to accelerate the development of external-facing, product-ready AI capabilities that materially differentiate RWS offerings, improve customer outcomes, and drive revenue growth across the business. The team provides a centralized, execution-focused capability that productizes AI at scale. It delivers reusable platforms, proven patterns, and clear guardrails so product teams can rapidly ship secure, high-quality, and commercially relevant AI features, consistently and sustainably.
Job Overview
- Key Responsibilities
- Architecture and technical strategy: Contribute to the design and architecture of core platform components and evaluation systems, making the load-bearing technical decisions and bearing accountability for their reliability, scalability, and long-term maintainability.
- Help set the technical direction for how AI capabilities are built, evaluated, and deployed across the company, and define a coherent platform vision that scales beyond your immediate team.
- Design reusable abstractions, SDKs, and services for model integration, prompt management, experimentation, and deployment that establish organization-wide patterns and reduce duplicated effort.
- Research and delivery excellence: Help define the evaluation strategy and methodology for AI capabilities across the company – automated metrics, human-in-the-loop workflows, test set management, and benchmarking – and establish the quality standards other teams build against.
- Build evaluation frameworks and developer tooling robust enough for production yet simple enough for non-specialist developers to adopt.
- Establish observability standards for AI systems – quality, performance, cost, and regression signals – and build dashboards and reporting that turn those signals into actionable decisions.
- Drive engineering rigor in delivery through testing discipline, reproducibility, sound experimental design, and statistically defensible measurement of model quality.
- Technical leadership: Provide technical leadership on the team's most ambiguous and highest-impact problems, scoping and sequencing work where direction is limited.
- Mentor engineers and raise engineering standards through code review, design review, and leading by example.
- Contribute to model and system governance practices including documentation (model cards, system cards), dataset and test-set versioning, reproducibility, and responsible-AI checks embedded directly into the platform.
- Act as a technical multiplier – codifying best practices into tooling and standards adopted by hundreds of developers.
- Innovation and technology adoption: Track developments in LLMs, evaluation research, and AI tooling, and translate them into pragmatic, well-scoped improvements to the platform.
- Prototype and de-risk emerging techniques and tools, shepherding the promising ones from experiment to supported capability.
- Champion the adoption of new platform capabilities across teams, lowering the barrier for developers to use them well.
- Keep the platform current and competitive without chasing novelty for its own sake.
- Cross-functional collaboration and stakeholder leadership: Partner with research, product, and localization leaders to align evaluation methodology with real-world quality and customer needs.
- Influence roadmap and technical strategy beyond your immediate team, building consensus across engineering and product stakeholders.
- Gather requirements from developers across the company and represent their needs in platform direction, acting as a trusted technical partner.
- Communicate technical direction, trade-offs, and quality standards clearly to both technical and non-technical audiences.
Skills & Experience
- Significant software engineering experience (typically 5+ years) building and operating production systems, tools, libraries, or services that many other engineers depend on, with excellent API design, reliability, and developer experience. Also, a track record with CI/CD and cloud infrastructure.
- Proficiency in Python and/or another general-purpose language, with strong testing discipline.
- Hands-on experience building with LLMs or other ML systems (prompt engineering, fine-tuning, retrieval, model integration), with an understanding of their failure modes and tradeoffs.
- Proven experience designing and leading evaluation for AI/ML systems: defining metrics and methodology, building evaluation pipelines, managing test sets, and reasoning rigorously about model quality and regressions.
- Strong command of evaluation concepts — various types of metrics (accuracy, precision, recall, F1), the distinction and tradeoffs between automated and human evaluation, statistical significance, and the limits of each approach.
- Excellent written and verbal communication, and a history of influencing technical direction across teams and mentoring other engineers.
- Comfort with ambiguity and the judgment to scope, prioritize, and sequence high-impact work with limited direction.
Preferred
- Deep experience evaluating NLP, machine translation, or content-generation systems, including metrics such as COMET, chrF++, BLEU, MetricX, and MQM-style human evaluation.
- Experience with experimentation and observability tooling, data/test-set versioning, and rigorous benchmarking workflows.
- Established practice in AI governance and documentation - model cards, system cards, reproducibility, and responsible-AI considerations - at an organizational level.
- Broad familiarity with the modern LLM ecosystem (open and proprietary models, orchestration frameworks, vector stores) and well-formed views on the tradeoffs.
- Experience supporting multilingual or localization-focused products at enterprise scale.
Life at RWS
Life at RWS - If you like the idea of working with smart people who are passionate about growing the value of ideas, data and content by making sure organizations are understood, then you’ll love life at RWS. Our purpose is to unlock global understanding. This means our work fundamentally recognizes the value of every language and culture. So, we celebrate difference, we are inclusive and believe that diversity makes us strong. We want every employee to grow as an individual and excel in their career. In return, we expect all our people to live by the values that unite us: to partner, putting clients first and winning together, to pioneer, innovating fearlessly and leading with vision and courage, to progress, aiming high and growing through actions and to deliver, owning the outcome and building trust with our colleagues and clients. RWS embraces DEI and promotes equal opportunity, we are an Equal Opportunity Employer and prohibit discrimination and harassment of any kind. RWS is committed to the principle of equal employment opportunity for all employees and to providing employees with a work environment free of discrimination and harassment. All employment decisions at RWS are based on business needs, job requirements and individual qualifications, without regard to race, religion, nationality, ethnicity, sex, age, disability, or sexual orientation. RWS will not tolerate discrimination based on any of these characteristics.
Senior AI Engineer in Maidenhead employer: RWS
RWS is an exceptional employer that champions inclusivity and diversity, making it a vibrant workplace for individuals passionate about brand protection. Located in London, employees benefit from a collaborative culture that prioritises personal growth and professional development, alongside the opportunity to work with innovative teams dedicated to unlocking global understanding. With a strong commitment to equal opportunity, RWS fosters an environment where every voice is valued, ensuring a rewarding experience for all employees.