Senior Data Engineer in London

Senior Data Engineer in London

London Full-Time 60000 - 80000 £ / year (est.) Home office (partial)
Novatus

At a Glance

  • Tasks: Design and evolve data frameworks, mentor junior team members, and optimise data pipelines.
  • Company: Join a fast-growing RegTech SaaS provider shaping the future of compliance.
  • Benefits: Enjoy private medical insurance, life insurance, flexible hours, and professional development opportunities.
  • Other info: Dynamic work culture with opportunities for career progression and collaboration.
  • Why this job: Be part of a pivotal transformation in data infrastructure for major financial institutions.
  • Qualifications: Experience with Python, PySpark, and designing auditable data pipelines is essential.

The predicted salary is between 60000 - 80000 £ per year.

Novatus Global is a Series B scale-up RegTech SaaS provider and boutique advisory firm, helping financial institutions manage their most complex regulatory requirements. We combine deep consulting expertise with cutting-edge SaaS solutions, enabling clients to strengthen compliance, enhance resilience, and drive sustainable growth.

Our flagship SaaS platform, En:ACT (short for Enabling Accurate Compliance in Transaction reporting), is a market-leading solution for regulatory transaction reporting and reconciliation across global regimes. En:ACT automates reporting, reconciles data across systems, and maps errors directly to regulatory rules, helping firms remediate quickly, reduce risk, and meet regulatory obligations with confidence. Already trusted by more than 30 firms worldwide, the platform is scalable, proven, and designed for both business and technical users.

Alongside our SaaS offering, our unique model delivers consulting services across Risk & Compliance (including Transaction Reporting and Operational Resilience), ESG, Strategy, Data, and Operations. Unlike larger consultancies, we embed ourselves within client teams to deliver both insight and execution, taking ownership of outcomes and driving measurable impact.

Since our launch in 2019, we have scaled rapidly, creating space for our people to grow with the business. Backed by North American private equity investment, and partnerships with the London Stock Exchange Group and Snowflake's global data platform, we are shaping the future of regulatory compliance through innovation in both advisory and technology. Our growth plans do not stop here; we are on the lookout for top-tier talent to join us on our journey and enable our next phase of success.

As a Senior Data Engineer, you will be developing our configuration-driven data platform in Databricks, enabling non-engineers to define regulatory logic, and our Snowflake data warehouse, ensuring scalability, auditability, and fitness for client-facing regulatory use cases. You'll be writing clean, maintainable and well-tested code that follows best practices. As a senior member of the team, you will be providing technical leadership and mentorship to your colleagues. You'll join at a pivotal stage as we modernize our data infrastructure, migrating from Python scripts and MySQL to Databricks and Snowflake. Our systems power regulatory reporting for major financial institutions, requiring precision, traceability, and reliability.

What You'll Do

  • Design and evolve our configuration-driven data framework in Databricks and our Snowflake warehouse.
  • Mentor Junior members of the team, aiding their growth and acting as a force multiplier through your technical leadership.
  • Design, build, and optimize data pipelines using Databricks, Kafka, Python and PySpark.
  • Ensure pipelines are auditable, lineage-aware, idempotent, and resilient in regulated environments.
  • Implement robust data quality controls including testing, validation, monitoring, and alerting.
  • Drive performance optimization across Spark and Snowflake workloads.
  • Partner with Product, Engineering, DevOps, and Regulatory teams to translate requirements into scalable technical designs.
  • Contribute to the continuous improvement of our development processes and tools.

Must-Haves

  • Experience designing auditable, reproducible data pipelines in regulated or high-integrity environments using Python and PySpark.
  • Able to write and optimize complex SQL queries on large data sets.
  • Strong data modeling and warehouse design fundamentals.
  • Strong software engineering fundamentals (clean code, automated testing, CI/CD, observability).
  • Experience with modern cloud data platforms and orchestration tools.
  • Comfortable translating complex regulatory requirements into technical specifications.
  • Ability to work autonomously with a high degree of accountability for the systems you build and maintain.

Nice-to-Haves

  • Experience with Kafka or other event streaming platforms.
  • Hands-on experience with AWS cloud infrastructure.
  • Experience building new data platforms or modernizing legacy systems.
  • FinTech, RegTech, or financial services background.

Perks & Benefits

  • Private Medical Insurance (AXA) – includes mental health, dental, vision, and private GP access.
  • Life Insurance (4× salary) with Unum.
  • Unum's Help@Hand: includes medical second opinions, physiotherapy, lifestyle coaching, savings and discounts, and cancer support services for you, your partner, and your child(ren).
  • Employee Assistance Program.
  • Enhanced parental leave (maternity & paternity).
  • Professional qualification sponsorship.
  • Accelerated career progression based on performance, not tenure.
  • Holiday entitlement increases with tenure.
  • Flexible hours with core collaboration time.
  • Paid volunteering leave.
  • Gym & fitness discounts.
  • Quarterly socials, and office snacks & drinks.
  • Interest-based working groups to collaborate and innovate.

Equal Opportunities Statement

Novatus is an Equal Opportunity Employer. All employment decisions are made based on business needs, role requirements, and individual qualifications, without regard to race, age, religion or belief, sex, sexual orientation, gender identity or expression, marital or civil partnership status, pregnancy or maternity, socioeconomic background, disability, or any other characteristic protected under the Equality Act 2010. We maintain a workplace culture that is inclusive, respectful, and supportive. Our recruitment and selection processes are designed to ensure fairness and consistency for all candidates. Reasonable adjustments are available throughout the application and interview process, and candidates are encouraged to contact Human Resources to discuss any specific requirements. This commitment is embedded in all aspects of our employment practices, including recruitment, compensation, professional development, promotion, and workplace conduct.

Senior Data Engineer in London employer: Novatus

At Novatus Global, we pride ourselves on being an exceptional employer that fosters a culture of innovation and collaboration. As a Senior Data Engineer, you'll not only have the opportunity to work with cutting-edge technology in a rapidly growing scale-up but also benefit from a supportive environment that prioritises professional development and career progression. With flexible working hours, comprehensive health benefits, and a commitment to employee well-being, Novatus Global is dedicated to empowering our team members to thrive both personally and professionally.
Novatus

Contact Detail:

Novatus Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Senior Data Engineer in London

✨Tip Number 1

Network like a pro! Reach out to folks in the industry, attend meetups, and connect with people on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.

✨Tip Number 2

Show off your skills! Create a portfolio or GitHub repository showcasing your projects, especially those related to data engineering. This gives potential employers a taste of what you can do beyond just a CV.

✨Tip Number 3

Prepare for interviews by practising common technical questions and scenarios relevant to data engineering. Mock interviews with friends or using online platforms can help you feel more confident and ready.

✨Tip Number 4

Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who are proactive about their job search!

We think you need these skills to ace Senior Data Engineer in London

Databricks
Snowflake
Python
PySpark
SQL
Data Pipeline Design
Data Quality Controls
Performance Optimization
Cloud Data Platforms
CI/CD
Observability
Technical Leadership
Regulatory Compliance
Data Modeling
Event Streaming (Kafka)

Some tips for your application 🫡

Tailor Your Application: Make sure to customise your CV and cover letter for the Senior Data Engineer role. Highlight your experience with Databricks, Snowflake, and Python, as well as any relevant projects that showcase your skills in building data pipelines.

Showcase Your Technical Skills: We want to see your technical prowess! Include specific examples of how you've designed auditable data pipelines or optimised SQL queries. This will help us understand your hands-on experience and problem-solving abilities.

Be Clear and Concise: When writing your application, keep it clear and to the point. Use bullet points where possible to make it easy for us to read through your qualifications and achievements. We appreciate a well-structured application!

Apply Through Our Website: Don’t forget to submit your application through our website! It’s the best way for us to receive your details and ensures you’re considered for the role. Plus, it helps us keep everything organised on our end.

How to prepare for a job interview at Novatus

✨Know Your Tech Stack

Make sure you’re well-versed in Databricks, Snowflake, and the tools mentioned in the job description. Brush up on your Python and PySpark skills, and be ready to discuss how you've used them in past projects. This will show that you can hit the ground running.

✨Showcase Your Problem-Solving Skills

Prepare to discuss specific challenges you've faced in data engineering, especially in regulated environments. Think about how you designed auditable data pipelines or optimised SQL queries. Real-world examples will demonstrate your expertise and thought process.

✨Emphasise Mentorship Experience

As a senior role, they’ll want to know how you can lead and mentor junior team members. Share experiences where you’ve guided others, improved team performance, or contributed to a positive learning environment. This shows you’re not just a tech whiz but also a team player.

✨Understand Regulatory Requirements

Since the company focuses on regulatory compliance, brush up on relevant regulations and how they impact data engineering. Be prepared to discuss how you translate complex regulatory requirements into technical specifications. This will highlight your ability to bridge the gap between tech and compliance.

Senior Data Engineer in London
Novatus
Location: London

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

>