VP of Security & Infrastructure

500M+ downloads. 80M+ monthly users. A decade of building – and we’re still accelerating. Flo is the world’s #1 health & fitness app worldwide on a mission to build a better future for female health. Backed by a $200M investment led by General Atlantic, we became the first product of our kind to reach a $1B valuation in 2024 – and we’re not slowing down. With 7M paid subscribers and the highest-rated experience in the App Store’s health category, we’ve spent 10 years earning trust at scale. Now, we’re building the next generation of digital health – AI-powered, privacy-first, clinically backed – to help our users know their body better.

The job We are looking for a Senior AI Engineer with strong LLM and product engineering experience to join our AI Platform team and help ship the AI-driven features across our app — including personalized in-app content recommendations, conversational AI-powered insights, and AI-generated mobile push notifications. You will focus on the product-facing behavior of our GenAI features (relevance, quality, latency, and safety), using the platform’s judges, fine-tuning pipelines, and evaluation tools, and contributing to infrastructure work (Databricks, AWS, Terraform) as initiatives require it.

What you’ll do:

• Feature development: build and ship LLM-powered product features, including AI-generated mobile push notifications, personalized in-app content recommendations and custom user journeys, and conversational AI-powered insights — including structured output such as charts and widgets.
• Latency and UX: reduce perceived and actual response latency through streaming, pregeneration, and inference-time tradeoffs, working closely with product and design on how AI output is experienced by users.
• Prompt and model behavior: iterate on prompt design and calibration, use fine-tuned health-domain models (Llama, Gemma, MedGemma) where relevant, and work with the Judge-as-a-Service ecosystem to keep outputs safe and high quality.
• Experimentation: help enable A/B testing for model and prompt changes, using evaluation gates to ship safely and measure impact.
• Data and evaluation: contribute to synthetic Q&A generation, golden test sets, and evaluation dataset design that supports the features you’re building.
• Infrastructure: contribute to Databricks, AWS (EKS), Terraform, or CI/CD work as initiatives require it.
• Cross-functional impact: collaborate with Product, Security, Analytics, and Medical teams, and engage with technology partners (Databricks, Google, OpenAI, Anthropic, AWS) on pre-release capabilities relevant to your features.

Experience and skills:

• Must have: 7+ years of software engineering, with recent hands‑on experience building product features backed by LLMs; experience with at least one of: prompt engineering, LLM evaluation, fine‑tuning, or model serving; strong Python, and comfort working with APIs/SDKs that wrap LLM calls, prompt templates, and structured outputs; product sensibility: a track record of shipping user‑facing features, with attention to latency, tone, and quality of AI output as experienced by end users; comfort picking up new infrastructure tools (Databricks, AWS, Terraform, GitHub Actions) as needed — deep prior expertise not required.
• Nice to have: LLM evaluation frameworks (judges, graders, calibration methodology) or fine‑tuning techniques (LoRA, RLHF/DPO, model distillation); prompt optimisation frameworks (DSPy or similar); feature stores or personalization/ranking experience (relevant to in‑app content recommendation work); healthcare, regulated‑industry, or safety‑critical AI systems experience.

Annual Salary Range (ranges may vary based on skills and experience)

What you’ll get:

• Competitive salary and annual reviews.
• Opportunity to participate in Flo’s performance incentive scheme.
• Paid holiday, sick leave, and female health leave.
• Enhanced parental leave and pay for maternity, paternity, same‑sex and adoptive parents.
• Accelerated professional growth through world‑changing work and learning support.
• In‑person collaboration and work in a hybrid model, with 3 days per week spent in the office.
• 5‑week fully paid sabbatical at 5-year Floversary.
• Flo Premium for friends & family, plus more health, pension and wellbeing perks.

Diversity, equity and inclusion Our strength is in our differences. At Flo, hiring is based on merit, skill and what you bring to the role – nothing else. We’re proud to be an equal opportunity employer, and we welcome applicants from all backgrounds, communities and identities.