At a Glance
- Tasks: Lead child safety initiatives and develop strategies to combat online exploitation.
- Company: Join a pioneering research lab focused on open intelligence and AI.
- Benefits: Top-tier salary, stock options, unlimited PTO, and comprehensive health benefits.
- Other info: Dynamic team culture with opportunities for personal and professional growth.
- Why this job: Make a real difference in child safety while shaping the future of AI.
- Qualifications: Expertise in child safety and experience in content moderation or policy enforcement.
The predicted salary is between 63000 - 77000 £ per year.
Our Mission Reflection is a research lab making intelligence open and accessible for everyone to use, customize, and build on. We build open models that let anyone control their intelligence and help shape the future of AI. Our mission: make intelligence open and accessible to all.
Role Overview As a Subject Matter Expert, Child Safety, you are our internal authority on preventing, detecting, and responding to child sexual abuse material (CSAM) and child sexual exploitation material (CSEM) generated or facilitated through Reflection's models and products. You will define how the lab thinks about child safety, translate that expertise into concrete enforcement workflows and detection strategies, and act as a critical gatekeeper ensuring our open releases meet our child safety commitments.
You will own child safety evaluations, human grading, auto-grading, enforcement end to end: standing up and scaling review workflows, serving as the primary point of contact for those who conduct content review, as well as conduct them yourself, driving model launch evals on novel or ambiguous cases, and partnering closely with our technical Safety team, Alignment, Policy, and Legal teams to close gaps as the threat landscape evolves. You will also represent Reflection's child safety work externally with reporting bodies, NGOs, researchers, and, where appropriate, law enforcement.
Because we ship open weights, the stakes are distinctive: your judgment shapes safeguards that must hold up in adversarial, real-world use. In this position you will regularly be exposed to and engage with explicit content of a sexual nature involving minors, as well as content that may be violent or psychologically disturbing. Reflection takes the wellbeing of team members working in this area seriously and provides access to wellness resources, trauma-informed support, and appropriate operational safeguards. We ask candidates to consider this aspect of the role carefully before applying.
What You'll Do:
- Serve as Reflection's internal subject matter expert on child safety, CSAM/CSEM, and online child sexual exploitation and abuse (CSEA), and set the standards, definitions, and escalation thresholds the lab operates against.
- Partner with Safety research and engineering teams to create new automated evaluations.
- Own the day-to-day operation of child safety content evaluation and review workflows, including task routing, queue management, quality assurance, escalation handling, and SLA monitoring.
- Serve as the primary point of contact for review partners conducting child safety content review, including onboarding, training, calibration, and ongoing support.
- Review novel or ambiguous flagged content to drive enforcement decisions, and surface policy and product gaps to the Alignment, Safety, and Policy teams.
- Partner with engineering to design, evaluate, and improve detection models, hash-matching pipelines, and automated enforcement systems, and to build child safety considerations into our pre-release evaluation and red-teaming process.
- Validate that models meet Reflection's child safety risk thresholds before open weights ship.
- Develop and maintain internal documentation, decision trees, and review guidelines that enable accurate, consistent enforcement at scale.
- Identify and report emerging misuse patterns and threat actor behaviour to internal stakeholders across the company.
- Coordinate reporting obligations to relevant external bodies (e.g., NCMEC) in accordance with applicable law and Reflection policy.
- Stay current on evolving legal frameworks, enforcement best practices, and child safety technology, and use these to keep our workflows ahead of the threat landscape.
What We're Looking For:
- Deep subject matter expertise in child safety, child sexual exploitation and abuse (CSEA), or online child protection.
- Experience in trust & safety, content moderation operations, or policy enforcement with direct exposure to child safety, CSAM/CSEM, or related harm areas.
- Experience managing or coordinating content review operations, including quality assurance and workflow management.
- Experience standing up and scaling policy enforcement or content review workflows.
- Proficiency in SQL and/or other data analysis tools to monitor workflow health, review-queue metrics, and enforcement trends.
- Track record of identifying emerging risks and communicating findings clearly to cross-functional stakeholders across Product, Policy, Engineering, and Legal.
- Sound judgment under time pressure and comfort making high-stakes decisions, including ones that affect whether a model ships.
- Familiarity with CSAM/CSEM classification standards (e.g., COPINE, SAM scale).
- Experience working with or reporting to NCMEC, IWF, or equivalent child safety reporting bodies.
- Familiarity with relevant legal and regulatory frameworks, including CSAM reporting obligations, KOSA, COPPA, or equivalent international frameworks.
- Experience with generative AI products and an understanding of how AI systems can be misused to generate or facilitate CSEA.
- Experience with hash-matching or perceptual hashing technologies used in CSAM detection (e.g., PhotoDNA, CSAI Match).
- Familiarity with age assurance technologies and their role in child safety enforcement.
- Experience designing or evaluating trauma-informed support structures and wellness protocols for content reviewers.
- Proficiency in Python for workflow automation or data analysis.
- Additional language proficiency beyond English.
What We Offer:
- Top-tier compensation: Salary and equity structured to recognize and retain our talent globally.
- Stock options: Everyone who joins and contributes to Reflection's success gets to share in the upside through stock options.
- Health & wellness: Comprehensive medical, dental, vision, and life, with an annual wellness allowance.
- Meals: Lunch and dinner are provided in the office daily.
- Life & family: 22 weeks paid parental leave for all new birthing and non-birthing parents, including adoptive and surrogate journeys.
- Vacation days: Unlimited paid time off in the U.S. and 30 days in the U.K.
- Sponsorship support: We sponsor visas to help exceptional talent join our team and support long-term immigration pathways where applicable.
- Team building: We have regular off-sites, happy hours, and team celebrations.
Export Control Notice: This position may require access to technology or source code subject to the U.S. Export Administration Regulations. Any offer of employment for this role may be conditioned on the Company's ability to provide the candidate with access to such technology or source code in compliance with applicable U.S. export control laws, which may require the Company to seek government authorization.
Subject Matter Expert - Child Safety employer: Reflection
At Reflection, we pride ourselves on being an exceptional employer that champions innovation and collaboration in the rapidly evolving field of AI. Our inclusive work culture fosters personal and professional growth, offering top-tier compensation, comprehensive health benefits, and unlimited paid time off to ensure a healthy work-life balance. Join us in shaping the future of open foundational models while enjoying unique perks like daily meals and generous parental leave policies, all within a dynamic and supportive environment.
StudySmarter Expert Advice🤫
We think this is how you could land Subject Matter Expert - Child Safety
✨Dive into Local Community Groups
Social work thrives on community connections, so get involved in local groups or forums specific to your interests. Whether it’s volunteering at local shelters or joining community action boards, these are great ways to boost your visibility and make direct contacts that could lead to opportunities like the one at Reflection.
✨Attend Social Work Events and Workshops
Keep an eye out for workshops, seminars, or conferences in social work. These events are fantastic for meeting professionals in the field, learning about emerging trends, and spotting job openings. Plus, you might just bump into someone from Reflection!
✨Showcase Your Passion and Expertise
Use platforms like Instagram or LinkedIn to share your journey and insights into the social work sector. Whether it’s writing about your experiences or sharing relevant articles, this helps to establish you as an engaged professional. Potential employers, like Reflection, will notice your enthusiasm!
✨Leverage Your Network
Don’t hesitate to reach out to professors, mentors, or even past colleagues who are in social work. They might have inside knowledge about openings at Reflection or be able to connect you with someone who’s hiring. Networking is key, especially in a full-time role where relationships matter.
We think you need these skills to ace Subject Matter Expert - Child Safety
Some tips for your application 🫡
Show Your Passion for Social Work:In your cover letter, let us see your passion for social work shine through! Talk about the experiences that made you want to pursue this career—whether it’s volunteering, personal experiences, or academic projects. We want to know why this field matters to you.
Emphasise Relevant Qualifications:Make sure your CV highlights any relevant qualifications, like degrees in social work or certifications like a DBS check. If you've done any workshops or training, don’t forget to include those as well. We're keen to see your commitment to your professional development!
Detail Your Experience with Clients:Since this is a hands-on field, detailing any direct experience you have with clients is crucial. Whether it's internships, volunteer roles, or previous jobs, highlight those experiences in your CV to show us you've got the practical skills necessary for the job!
Tailor Your Application to Reflection:Before hitting send, make sure to tailor your application specifically to Reflection! Research our mission and values, and refer to them in your cover letter. This shows us that you understand our work and are genuinely interested in being a part of our team!
How to prepare for a job interview at Reflection
✨Understanding the Role of Empathy
In social work, understanding and demonstrating empathy is key. Be prepared to share personal experiences or scenarios where you effectively showed compassion and support. This helps show that you genuinely care about the well-being of others, which is crucial in social work.
✨Demonstrating Knowledge of Frameworks
Familiarise yourself with the frameworks and models used in social work, such as the Strengths-Based Approach or the Ecological Perspective. Be ready to discuss how these frameworks apply to your work, especially if you can tie them into real-world examples or case studies you've encountered.
✨Showcasing Your Multi-Disciplinary Skills
In a full-time social work role, you'll often collaborate with healthcare professionals, educators, and law enforcement. Be prepared to describe your teamwork experiences and how you've effectively communicated with other disciplines to achieve the best outcomes for clients.
✨Preparing for Scenario-Based Questions
Expect questions that put you in hypothetical social work situations, such as dealing with a crisis or managing a complex case. Think through your thought process for these scenarios beforehand, considering how you'd assess the situation and what steps you'd take, as this demonstrates your critical thinking and problem-solving abilities.