Staff Data Engineer | Contract | U ... in London

Staff Data Engineer | Contract | U ... in London

London Full-Time 63000 - 77000 £ / year (est.) Hybrid
W

At a Glance

  • Tasks: Lead data engineering projects, optimise pipelines, and apply AI tools for enhanced productivity.
  • Company: Major UK financial services organisation undergoing data transformation.
  • Benefits: Competitive daily rate, hybrid work model, and impactful project involvement.
  • Other info: Opportunity for significant career growth in a dynamic, tech-driven environment.
  • Why this job: Make a real difference in enterprise data transformation while honing your engineering skills.
  • Qualifications: Expertise in Python/PySpark, AWS, and strong architectural thinking required.

The predicted salary is between 63000 - 77000 £ per year.

We're supporting a major UK financial services organisation through a significant programme of data engineering modernisation and transformation. We're looking for a genuinely Staff-level Data Engineer who combines exceptional hands-on Python/PySpark engineering with strong architectural thinking and practical experience of AI-assisted software development. This is not a hands-off architecture role. You need to be equally comfortable setting technical direction, challenging engineering approaches and independently writing, debugging and optimising production-quality code. The sweet spot is someone who can operate at a strategic level while remaining an outstanding hands-on engineer.

The role will play a key part in modernising a large-scale enterprise data estate, including the migration and transformation of thousands of data pipelines, development of new data products and adoption of modern, AI-assisted engineering practices. Responsibilities will include:

  • Providing Staff-level technical leadership across complex data engineering and modernisation initiatives.
  • Remaining deeply hands-on with Python, PySpark and Apache Spark, independently building and proving engineering solutions.
  • Designing and optimising scalable data pipelines and processing frameworks across AWS.
  • Tackling complex Spark performance challenges, including shuffles, joins, data skew, partitioning and memory optimisation.
  • Designing and challenging engineering approaches across AWS Glue, Apache Airflow and associated technologies.
  • Reviewing existing code, identifying performance bottlenecks and driving improvements in engineering quality.
  • Establishing reusable engineering patterns, frameworks and approaches to accelerate large-scale data migrations.
  • Applying AI-assisted development tools to improve engineering productivity, code quality and delivery speed.
  • Challenging technical assumptions, influencing architectural decisions and raising engineering standards across multiple teams.

What we’re looking for:

  • Core engineering capability: Exceptional hands-on Python/PySpark and Apache Spark expertise, with the ability to independently write, debug and optimise complex production code. Deep understanding of Spark internals and performance optimisation, including execution plans, joins, shuffles, partitioning, memory management and data skew. Strong AWS data engineering, particularly AWS Glue. Strong Apache Airflow experience. Excellent software engineering fundamentals, including code quality, testing, performance and maintainability. Experience designing and delivering large-scale data pipeline migrations or modernisation programmes.
  • Technical leadership and AI-enabled engineering: Experience operating at Staff, Principal or Senior Lead Engineer level, or demonstrably performing at that standard. Ability to independently assess complex engineering challenges, challenge existing approaches and shape scalable solutions. Strong architectural and conceptual understanding, underpinned by genuine hands-on delivery experience. Demonstrable experience using AI-assisted development tools (such as Claude, GitHub Copilot or similar) to accelerate real-world software engineering delivery. Ability to critically review, validate and improve AI-generated code rather than relying on it without understanding. Experience influencing engineering practices and technical direction across multiple teams.
  • Beneficial experience: Snowflake. Legacy ETL modernisation and migration. Building reusable migration frameworks or automation to accelerate large-scale transformation programmes. Financial services or other complex, highly regulated environments.

What makes someone successful in this role? We're looking for a relatively rare combination of capabilities: A genuinely excellent hands-on Spark engineer who can think architecturally, solve complex problems independently and use AI to accelerate engineering delivery. You'll need to be comfortable discussing high-level technical strategy one minute and getting directly into complex PySpark code the next. This is an opportunity to have a meaningful impact on a major enterprise transformation programme while remaining at the forefront of hands-on engineering.

Staff Data Engineer | Contract | U ... in London employer: Wedo Technology Solutions Ltd.

Join a forward-thinking technology business that prioritises security and innovation, offering a dynamic work environment in Shoreditch, London. With a strong focus on employee growth, you will have the opportunity to enhance your skills in cloud security while contributing to significant projects aimed at achieving SOC 2 compliance. Enjoy a collaborative culture that values your input and encourages a security-first mindset, all while benefiting from competitive salary packages and flexible working arrangements.

W

Contact Details:

Wedo Technology Solutions Ltd. Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Staff Data Engineer | Contract | U ... in London

✨Get Involved in Data Science Meetups

Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like Wedo Technology Solutions Ltd.!

✨Show Off Your Projects

Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Staff Data Engineer | Contract | U ... at Wedo Technology Solutions Ltd..

✨Leverage Professional Networks

Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like Wedo Technology Solutions Ltd..

✨Apply Directly through Our Website

When you find a suitable opening like Staff Data Engineer | Contract | U ... at Wedo Technology Solutions Ltd., make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!

We think you need these skills to ace Staff Data Engineer | Contract | U ... in London

Python
SQL
Problem-Solving Skills
Communication Skills
Data Governance
Data Engineering
API Integration

Some tips for your application 🫡

Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!

Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!

Craft a Tailored Cover Letter:For a full-time role at Wedo Technology Solutions Ltd., your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.

Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at Wedo Technology Solutions Ltd.. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!

How to prepare for a job interview at Wedo Technology Solutions Ltd.

✨Brush Up on Your Statistics

For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!

✨Showcase Your Projects

Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!

✨Get Comfortable with Python and R

Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at Wedo Technology Solutions Ltd.!

✨Prepare for Case Studies

Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.