Senior Data Platform Engineer - Cyber Data Platform

As the Senior Data Platform Engineer in the Cyber Data Platform team, you will play a key role in building and maintaining a robust data platform that enables users to develop advanced analytics, machine learning, and GenAI solutions to strengthen our security defences. You will collaborate closely with cross‑functional data teams to ensure the platform is scalable, secure, and aligned with cybersecurity goals, contribute to the data platform architecture, and mentor junior members.

Responsibilities

• Data Architecture – Design, build and manage real‑time, near real‑time and batch data architectures that support threat detection, incident response and reporting through advanced analytics, machine learning and GenAI capabilities.
• Data Integration and Transformation – Implement and manage automated frameworks for integrating data from various security sources into the security data lake and for moving data between raw, trusted and curated data layers.
• Coding – Contribute to raising the team’s code quality by producing high‑quality code, conducting thorough peer reviews, and providing constructive feedback.
• Automation and DevOps – Implement various automations and DevOps practices to streamline the deployment, configuration and management of data platform components.
• Collaboration and Communication – Collaborate with teams from various departments, communicating technical concepts and solutions to stakeholders with diverse technical expertise.
• Recruitment & Talent Development – Support the ongoing recruitment and talent development process for the cyber data team.

Key People and Teams

• Members of the cyber data platform team (Engineering Managers, Product Managers, Data Platform, Analytics and Machine Learning Engineers)
• Members of the broader security team (Product Managers, Security Managers, Security Engineers, Security Testers, Security Analysts and Risk & Compliance team members)
• Security Stakeholders across Tesco

Operational Skills

• Strong communication skills, both written and verbal, to engage with team members and stakeholders.
• Strong analytical abilities to empower users with self‑service capabilities through the data platform.
• Experience with collaborative development methods such as mob or ensemble programming.

Qualifications and Experience

• Solid programming experience with Python and proficiency in SQL.
• Experience building data platforms on cloud services such as Databricks on Azure or GCP BigQuery, and big data technologies like Spark or Flink.
• Solid grasp of Kubernetes, CI/CD and Terraform.
• Working knowledge of ETL and ELT frameworks and orchestration tools such as Airflow and dbt.
• Ability to provide clear input, guide and empower junior team members to achieve desired outcomes.
• Familiarity with machine learning and AI tools is desirable.
• Knowledge of cybersecurity principles and practices.

Benefits

• Financial & Reward Benefits – Annual bonus scheme, retirement savings plan, life assurance, share schemes.
• Holiday & Time Off – Holiday starting at 25 days plus a personal day, plus 8 Bank holidays.
• Health & Wellbeing – On‑site gym, discounted Gympass membership, free health checks, employee assistance programme.
• Colleague Clubcard & Discounts – Colleague Clubcard, including a second card for a family member, after 3 months of service.
• Additional Benefits – Exclusive deals and discounts, cycle to work scheme, shuttle bus service, opportunities for learning and training, financial wellness support, participation in fundraising activities.