Senior Data Engineer in City of London

Senior Data Engineer in City of London

City of London Full-Time 63000 - 77000 £ / year (est.) Hybrid
O

At a Glance

  • Tasks: Lead the design and build of scalable data pipelines for top brands.
  • Company: Join a VC-backed AI and data consultancy in Edinburgh.
  • Benefits: Competitive salary, up to 37 days holiday, and private medical insurance.
  • Other info: Collaborative environment with excellent training and career growth opportunities.
  • Why this job: Make a real impact with leading companies while developing your skills.
  • Qualifications: Strong Python and SQL skills, experience with data processing platforms.

The predicted salary is between 63000 - 77000 £ per year.

Optima Partners is a VC-backed, scaling AI and data consultancy headquartered in Edinburgh. We bring together expertise in strategy, design, data science and engineering to help leading brands solve real business challenges. Our clients include Lloyds Banking Group, NatWest Group, Bank of Ireland, Nationwide, Aviva, Eon Next, OVO and GSK.

As a Senior Data Engineer within our Data practice, reporting to a Technical Lead, you will lead the design, build, testing and maintenance of reliable, scalable data pipelines and platforms for clients across diverse sectors. This role suits an experienced data engineer who combines strong hands-on delivery with sound technical judgement, client-facing confidence and a commitment to developing others.

What you will be doing:

  • Lead the design, build, testing and operation of scalable data pipelines using platforms such as Databricks.
  • Design and develop data warehouses, data lakes and lakehouse solutions.
  • Build and optimise robust ETL/ELT workflows, embedding data quality checks, monitoring and controls.
  • Work directly with clients and multi-disciplinary colleagues to translate business requirements into technical designs.
  • Deliver well-modelled, documented datasets that support analytics, dashboards and visualisations.
  • Provide hands-on technical leadership through design and code reviews, mentoring and knowledge sharing.
  • Troubleshoot complex production issues and improve performance, reliability and cost efficiency.
  • Maintain clear documentation and support effective client handover.

What skills we would like you to have:

  • Strong hands-on Python and SQL skills.
  • Practical experience building and optimising distributed data processing workloads using Spark and Databricks.
  • Experience with Delta Lake or comparable lakehouse technologies.
  • Experience delivering and operating data solutions on at least one major cloud platform.
  • Strong understanding of relational databases, advanced SQL and query optimisation.
  • Experience implementing orchestration, scheduling, dependencies and failure handling.
  • Strong data warehousing, modelling and schema design skills.
  • Experience using Git, automated testing and CI/CD.
  • Proven experience delivering production data engineering solutions end to end.
  • Experience working with clients or business stakeholders to clarify requirements.
  • Experience delivering iteratively within Agile or Scrum teams.

What you will bring:

  • Strong analytical and problem-solving skills.
  • An inquisitive mindset and a commitment to continuous improvement.
  • Clear, confident communication.
  • A collaborative, accountable approach.

What we offer:

  • Competitive base salary.
  • Inclusion in our annual discretionary bonus plan.
  • Up to 37 days holiday inclusive of personal and public allocations.
  • Private medical insurance, single cover.
  • Group life and income protection insurance.
  • Salary sacrifice pension scheme after three months’ employment.
  • Access to over 1,000 perks and discounts via an employee discount portal.
  • Dedicated development time plus tools and funding to support personal and professional development.

Senior Data Engineer in City of London employer: Optima Partners

Optima Partners is an exceptional employer, offering a dynamic work culture that fosters innovation and collaboration in the heart of London. Employees benefit from comprehensive professional development opportunities, competitive remuneration, and the chance to work with cutting-edge technologies in a regulated environment, making it an ideal place for those looking to make a meaningful impact in data architecture.

O

Contact Details:

Optima Partners Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Senior Data Engineer in City of London

✨Get Involved in Data Science Meetups

Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like Optima Partners!

✨Show Off Your Projects

Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Senior Data Engineer at Optima Partners.

✨Leverage Professional Networks

Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like Optima Partners.

✨Apply Directly through Our Website

When you find a suitable opening like Senior Data Engineer at Optima Partners, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!

We think you need these skills to ace Senior Data Engineer in City of London

Communication Skills
Python
Data Governance
Problem-Solving Skills
Data Pipeline Development
SQL
Data Engineering

Some tips for your application 🫡

Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!

Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!

Craft a Tailored Cover Letter:For a full-time role at Optima Partners, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.

Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at Optima Partners. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!

How to prepare for a job interview at Optima Partners

✨Brush Up on Your Statistics

For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!

✨Showcase Your Projects

Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!

✨Get Comfortable with Python and R

Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at Optima Partners!

✨Prepare for Case Studies

Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.