Senior Data Analyst

An exciting opportunity is available for a

Senior Data Analyst to drive analytics and evaluation for enterprise-scale search and AI-powered retrieval systems.

This role focuses on measuring search performance, developing experimentation frameworks, and delivering actionable insights that improve ranking quality, relevance, and user experience across advanced data products.

Working closely with data scientists, engineers, and product teams, you'll play a key role in shaping search evaluation strategies, optimizing AI-driven experiences, and enabling data-informed decision-making.

Key Responsibilities

• Lead analysis of search and retrieval system performance, including ranking quality and relevance.
• Define, standardize, and monitor search evaluation metrics such as NDCG, MAP, precision, recall, and CTR.
• Analyze user behaviour, query patterns, and content performance to identify optimization opportunities.
• Conduct in-depth analysis of ranking performance, query intent, and retrieval gaps.
• Support evaluation of AI-powered and retrieval-based applications.
• Design and lead A/B testing frameworks, ensuring statistical accuracy and meaningful experimentation.
• Partner with Product, Engineering, and Data Science teams to define success metrics and experiment strategies.
• Build scalable analytics workflows and reusable reporting templates.
• Develop dashboards and visualizations that track search performance and user engagement.
• Deliver clear, data-driven insights to both technical and non-technical stakeholders.
• Work with large-scale datasets using modern data platforms while maintaining high standards for data quality and measurement consistency.
• Collaborate with engineering teams to improve data collection, logging, and observability.
• Act as a trusted analytics partner across cross-functional teams and contribute to the continuous improvement of search evaluation practices.

Requirements

• Master's degree or Ph D in Data Analytics, Statistics, Computer Science, or a related field (or equivalent practical experience).
• Significant experience in data analytics, business intelligence, or similar analytical roles.
• Strong proficiency in SQL and Python for large-scale data analysis.
• Advanced experience with business intelligence and data visualization tools such as Tableau, Power BI, Looker, or similar.
• Experience working with Databricks, Spark, or comparable large-scale data platforms.
• Strong understanding of experimental design, A/B testing, and statistical analysis.
• Experience measuring search and retrieval performance using metrics such as NDCG, recall, precision, and ranking metrics.
• Ability to translate complex analytical findings into clear business recommendations.
• Excellent communication and stakeholder management skills.
• Preferred Experience
• Experience with search, ranking, recommendation, or information retrieval systems.
• Knowledge of indexing, ranking algorithms, and query understanding.
• Experience working with clickstream data and user behaviour analytics.
• Exposure to machine learning evaluation frameworks.
• Familiarity with Retrieval-Augmented Generation (RAG) systems and Generative AI applications.
• Flexible and hybrid working options.
• Generous annual leave with the option to purchase additional leave.
• Private healthcare and wellbeing support.
• Pension scheme and life assurance.
• Share incentive programmes.
• Family-friendly leave policies.
• Professional development and study support.
• Volunteer leave and charity initiatives.
• Employee wellbeing programmes and additional lifestyle benefits.

This is an excellent opportunity for an experienced data professional looking to influence the performance of cutting-edge search and AI technologies while working on complex, high-impact analytical challenges within a collaborative, innovation-driven environment.

#J-18808-Ljbffr