At a Glance
- Tasks: Lead the Data Platform strategy and set engineering standards for scalability and efficiency.
- Company: Join Compare the Market, a tech-driven company making financial decisions easier for millions.
- Benefits: Inclusive culture, opportunities for growth, and a chance to make a real impact.
- Other info: Dynamic environment with a focus on performance and diverse teams.
- Why this job: Be part of a fast-paced team that values innovation and accountability.
- Qualifications: Extensive experience in Data Engineering and cloud-based platforms required.
The predicted salary is between 80000 - 100000 £ per year.
Curious about what’s next? So are we. Join Compare the Market and help to make financial decision making a breeze for millions.
At Compare the Market, we’re a purpose-driven business powered by tech and AI. We’re building high-performing, results-driven teams with the skills, mindset, and ambition to deliver outcomes at pace. Every role here plays a part in driving our mission forward, and we create an environment where you can bring your authentic self, grow a truly characterful career, and see the direct impact of your work on the lives of our customers. We’ve carved a meerkat-shaped niche and we’re looking for ambitious, curious thinkers who thrive in a fast-moving, high-impact environment. If you love accountability, embrace challenge, and want to make a real difference, you’ll fit right in.
What You’ll Be Doing
- Own the Data Platform architecture and strategy, defining the long-term target state and setting clear standards and guardrails to ensure scalability, resilience, and cost efficiency.
- Set the engineering bar by establishing best practices across data ingestion, streaming, transformation, modelling, CI/CD, orchestration, testing, observability, and governance.
- Act as the senior technical authority across data engineering, influencing architecture decisions and leading the Data Engineering Community of Practice to raise capability across the organisation.
- Champion “data as a product”, ensuring datasets and platform services are reliable, discoverable, reusable, and governed with clear ownership and service expectations.
- Drive strategic technical direction while remaining hands‑on where it matters—reviewing designs, validating patterns, and guiding complex problem‑solving without becoming a delivery bottleneck.
What We’re Looking For
- Extensive experience in Data Engineering within modern, cloud-based data platforms.
- Deep expertise in streaming‑first architectures, with strong knowledge of batch processing approaches.
- Strong experience across AWS data ecosystems, Databricks, dbt, CI/CD practices, and orchestration frameworks.
- Proven track record of defining and implementing large-scale platform architecture and engineering standards.
- Strong understanding of data modelling, ingestion patterns, performance optimisation, observability, governance, and security.
- Experience influencing senior engineers and stakeholders across multiple teams without formal authority.
- Experience leading engineering communities of practice and raising technical standards at organisational scale.
- Ability to operate independently in complex, high‑impact environments.
Why Compare the Market?
We’re a business built for pace and performance. Here, you’ll be encouraged to think differently, act boldly, and deliver brilliantly in a culture that values results and rewards progress. We believe diverse teams make better decisions, and we’re committed to creating an inclusive workplace where everyone feels empowered to grow, contribute, and thrive. If you’re ready to stretch yourself, raise the bar, and grow with a team that’s serious about performance, innovation, and purpose, we’d love to hear from you.
Principal Data Engineer in London employer: Compare the Market
At Compare the Market, we pride ourselves on being a purpose-driven employer that fosters a dynamic and inclusive work culture. Located in London and Peterborough, we offer our employees the opportunity to thrive in a fast-paced environment where innovation is celebrated, and personal growth is encouraged. With a strong focus on accountability and collaboration, we empower our team members to make meaningful contributions that directly impact the financial decision-making of millions.
StudySmarter Expert Advice🤫
We think this is how you could land Principal Data Engineer in London
✨Tip Number 1
Network like a pro! Reach out to current employees at Compare the Market on LinkedIn. A friendly chat can give you insider info and might just get your foot in the door.
✨Tip Number 2
Prepare for the interview by brushing up on your technical skills. Make sure you can talk confidently about data engineering concepts, especially those mentioned in the job description. We want to see your passion shine through!
✨Tip Number 3
Showcase your projects! Bring examples of your previous work that align with the role. Whether it’s a cool data platform you built or a problem you solved, we love seeing how you’ve made an impact.
✨Tip Number 4
Don’t forget to apply through our website! It’s the best way to ensure your application gets seen. Plus, it shows you’re serious about joining our team at Compare the Market.
We think you need these skills to ace Principal Data Engineer in London
Some tips for your application 🫡
Show Your Curiosity:When writing your application, let your curiosity shine through! Share examples of how you've tackled challenges in the past and what you’re eager to learn next. We love ambitious thinkers who are always looking for the next big thing.
Be Authentic:Don’t be afraid to show your true self in your application. We want to know who you are beyond your skills. Share your passions and what drives you—this helps us see how you’ll fit into our vibrant culture.
Highlight Your Impact:Make sure to include specific examples of how your work has made a difference in previous roles. We’re all about results here at Compare the Market, so showing us your impact will definitely catch our eye!
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way to ensure your application gets to us quickly and efficiently. Plus, you’ll find all the info you need about the role and our company there!
How to prepare for a job interview at Compare the Market
✨Know Your Data Inside Out
Make sure you’re well-versed in the latest trends and technologies in data engineering, especially around cloud-based platforms like AWS. Brush up on your knowledge of streaming architectures and batch processing approaches, as these will likely come up during your chat.
✨Showcase Your Problem-Solving Skills
Prepare to discuss specific examples where you've tackled complex data challenges. Think about how you influenced architecture decisions or led a community of practice. This will demonstrate your hands-on experience and ability to drive strategic direction.
✨Emphasise Collaboration and Influence
Since the role involves influencing senior engineers and stakeholders, be ready to share instances where you’ve successfully collaborated across teams. Highlight your communication skills and how you’ve raised technical standards without formal authority.
✨Be Authentic and Curious
Compare the Market values authenticity and curiosity, so don’t hesitate to show your personality during the interview. Ask insightful questions about their data platform strategy and express your eagerness to contribute to their mission of making financial decision-making easier for customers.
