Principal AI Engineer

Principal AI Engineer

Full-Time 90000 - 110000 £ / year (est.) Hybrid
M

At a Glance

  • Tasks: Lead the development of cutting-edge AI systems and set technical direction for innovative projects.
  • Company: Join Rapid7, a leader at the intersection of security and AI.
  • Benefits: Competitive salary, flexible work options, and opportunities for professional growth.
  • Other info: Dynamic team environment with mentorship opportunities and significant career advancement.
  • Why this job: Shape the future of AI in cybersecurity and make a real impact.
  • Qualifications: 12+ years in software or ML engineering with expertise in LLMs and AI systems.

The predicted salary is between 90000 - 110000 £ per year.

Our Engineering organisation is scaling its AI Engineering capabilities under new leadership, creating an opportunity to build the next generation of AI at Rapid7. We're looking for Principal AI Engineers to join us and help shape what comes next by defining and influencing the technical direction of our LLM and agentic AI systems. As a Principal AI Engineer, you'll raise the bar for engineering standards, and build truly cutting edge greenfield solutions that deliver real impact for our Global customers. Through your technical leadership and mentoring, you'll help shape our product and platform investments and influence how we build and scale AI across the organisation.

About the Team

AI is reshaping cybersecurity on both sides. Attackers can use AI to strike at machine speed, and only AI-powered defense can keep up. At the same time, organizations can only adopt AI with confidence if it is secure. Rapid7 sits at the intersection of security and AI, and we are building industry-defining products for this new era. Rapid7's AI Engineering team builds the AI that powers our security platform. We are AI engineers and applied scientists who take models from research to production, combining open-source and frontier LLMs, AI agents, and fast predictive models with more than 20 years of Rapid7 security expertise. Our work drives core use cases across Detection and Response, such as alert triage, threat investigation, and automated response, and Exposure and Remediation, such as vulnerability prioritization, attack surface risk assessment, and guided remediation. Together, these help customers stop threats faster and fix what matters most.

About the Role

As a Principal AI Engineer, you will set the technical direction for how Rapid7 builds, tunes and serves LLMs and agentic systems across its security products. You understand LLMs from the ground up, from transformer internals and training to fine-tuning and inference optimization, and you stay hands-on with the hardest problems. You know where LLMs shine and where they fall short, and you treat them as one tool in the AI toolbox, alongside predictive AI and classical ML, choosing the right approach for each problem.

Specifically your focus will be to:

  • Define the architecture and technical roadmap for LLM and agentic AI systems across Detection and Response and Exposure and Remediation
  • Lead model strategy: when to use frontier or open-source models, and when to fine-tune, distill, or post-train
  • Fine-tune, distill and post-train open-source LLMs on security data, from data curation through training, evaluation and deployment
  • Set engineering standards for context engineering, inference optimization, and evaluation across teams
  • Optimize LLM inference at scale with techniques such as speculative decoding, KV-cache management, continuous batching, quantization and custom kernels, balancing quality, latency and cost
  • Establish evals as the release gate for every AI system we ship
  • Lead design reviews and resolve the hardest technical trade-offs
  • Stay hands-on: prototype and build critical model, training and inference code yourself
  • Mentor Staff and Senior engineers and shape product and platform investment

The skills and qualities you'll bring include:

  • 12+ years of software or ML engineering experience, including 2+ years building production LLM or agentic AI systems.
  • A PhD in Computer Science, Machine Learning, AI or a related field is preferred, or equivalent depth of expertise demonstrated through industry experience and technical contributions
  • A track record of building scalable, production-grade AI systems used across multiple teams or products with a strong history of organization-wide impact through technical leadership, mentoring, and shared platforms and standards
  • LLMs from first principles: deep understanding of transformer architecture, attention, tokenization and positional encodings, and how models are trained and served, with the ability to implement core components from scratch
  • PyTorch: expert-level, including custom model code, training loops, mixed precision and distributed training (e.g., FSDP, DeepSpeed)
  • Fine-tuning and post-training: hands-on full and parameter-efficient fine-tuning (LoRA, QLoRA) of open-weight LLMs, distillation, and preference or RL-based methods (e.g., DPO, GRPO)
  • Context engineering: retrieval, memory, and context management for long-running agent workflows
  • Inference optimization: deep knowledge of prefill and decode, KV-cache management (e.g., PagedAttention, prefix caching), continuous batching, speculative decoding, FlashAttention and quantization, and serving at scale with vLLM, SGLang or TensorRT-LLM
  • Evals: defining evaluation strategy and benchmarks for LLM and agent systems
  • Strong predictive AI and classical ML fundamentals, and the judgment to choose between them and LLMs based on accuracy, latency and cost
  • Strong distributed systems and Python fundamentals
  • Takes ownership of significant technical outcomes across multiple teams

Principal AI Engineer employer: mymoose

mymoose is an attractive employer due to its commitment to innovation in AI and cybersecurity, providing employees with the chance to work on impactful projects. The company fosters a collaborative culture that emphasizes mentorship and professional development, making it an ideal place for those looking to advance their careers in a rapidly evolving field.

M

Contact Details:

mymoose Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Principal AI Engineer

✨Join Local Tech Meetups

Get out there and mingle with fellow developers by joining local tech meetups. It’s a fantastic way to meet people who might be working at mymoose or know someone who does. Plus, you can pick up some trendy tech skills and trends while you're at it!

✨Contribute to Open Source Projects

Show off your coding chops by jumping into open-source projects. Not only does this give you practical experience, but it also gets you noticed in the dev community. You'll create a killer portfolio that speaks volumes about your skills to mymoose.

✨Tap into Online Developer Communities

Don’t underestimate the power of online developer communities like GitHub, Stack Overflow, and even Reddit. Participate in discussions, share your projects, and build your visibility. We can often find opportunities through these channels that can lead to a full-time gig at companies like mymoose.

✨Explore Job Boards Specifically for Tech Roles

Keep your eyes peeled on job boards that focus on tech roles. Sites like TechCareers or Stack Overflow Jobs can often have listings for companies like mymoose that might not show up on broader job sites. Make it a habit to check these regularly, and don’t hesitate to apply directly through our website!

We think you need these skills to ace Principal AI Engineer

Software Engineering
Machine Learning Engineering
Production LLM Systems
Technical Leadership
Mentoring
Transformer Architecture
PyTorch

Some tips for your application 🫡

Show off your coding skills:When applying for a software engineering role, it's super important to showcase your coding skills. Make sure your CV includes your tech stack, any relevant programming languages you’re comfortable with, and examples of projects you've worked on. If you have a GitHub profile, link it up! We love to see code in action.

Tailor your portfolio:For a full-time role, we’d expect to see some solid examples of your work in your portfolio. Make sure to include at least two or three projects that highlight your problem-solving skills and your ability to work with different technologies. Focus on the projects that are most relevant to the position at mymoose.

Craft a killer cover letter:Your cover letter is your chance to stand out—make it personal! Explain why you want to work at mymoose and how your skills align with the role. Show us your passion for software development. We dig enthusiastic candidates who understand the value of collaboration and continuous learning!

Be clear and concise:When it comes to writing your CV and cover letter, clarity is key. Avoid jargon that could confuse us and stick to simple, direct language. Highlight your achievements with quantifiable results where possible, and keep everything easy to read. A well-organised application goes a long way!

How to prepare for a job interview at mymoose

✨Brush Up on Your Coding Skills

For a full-time software engineering role, it's crucial that we stay sharp with our coding abilities. Expect technical questions that might involve solving problems on the spot or discussing algorithms. Practise on platforms like LeetCode or HackerRank to get comfortable with the types of questions that often come up.

✨Know Your Tools and Frameworks

Make sure we’re well-acquainted with the tools and technologies listed in the job description. Familiarise ourselves with any specific frameworks or programming languages mentioned. If mymoose uses React or Node.js, for instance, be ready to discuss how we’ve used them in previous projects or coursework.

✨Showcase Your Projects

Bring along a portfolio that highlights our best work. This could be code samples, GitHub repositories, or any side projects we’ve built. Make sure we can talk through our thought process for each project, especially the challenges we faced and how we solved them—this shows our problem-solving skills in action.

✨Prepare for Behavioural Questions

While technical skills are key, full-time positions also require cultural fit. Be ready to discuss our previous experiences and how we handle teamwork, conflict, and deadlines. Brush up on the STAR method—Situation, Task, Action, Result—to clearly articulate our past experiences when discussing how we've contributed to a team.