Lead Data Engineer

Lead Data Engineer

Full-Time 43200 - 72000 £ / year (est.) No home office possible
Scott Logic

At a Glance

  • Tasks: Lead data engineering projects, build data platforms, and solve complex engineering challenges.
  • Company: Join a B Corp committed to creating bespoke software solutions for top UK companies and government departments.
  • Benefits: Enjoy 25-30 days of annual leave, flexible remote work, and perks like gym discounts and private medical services.
  • Why this job: Be part of a collaborative culture that values innovation, learning, and making a social impact.
  • Qualifications: Experience in data engineering, Python, SQL, and strong problem-solving skills are essential.
  • Other info: Opportunities for growth and hands-on client interaction in the London area.

The predicted salary is between 43200 - 72000 £ per year.

We work with some of the UK’s biggest companies and government departments to provide a pragmatic approach to technology, delivering bespoke software solutions and expert advice.

Our clients are increasingly looking to us to help them make the best use of their data. In building data platforms and pipelines, our data engineers create the foundation for diverse data & analytics solutions, including data science and AI. They build data lakes and warehouses, create the processes to extract or access operational data, and transform siloed datasets into integrated data models that allow insight into business performance and problems or training of ML models.

These are hands-on, client-facing roles, with openings at senior or lead level to suit your experience. You may be leading teams, setting technical direction, advising clients or solving tough engineering challenges. You\’d also be expected to spend some time on-site with clients in the London area on an ad-hoc basis.

Our data engineers combine a strong software engineering approach with solid data fundamentals and experience with modern tools. We’re technology agnostic, and we’re open minded when it comes to your existing skillset.

What are we looking for?

  • Good experience with some of the technologies and approaches typical in modern data engineering and reporting. Including storage, data pipelines to ingest and transform data, and querying & reporting of analytical data.
  • You\’ve worked with technologies such as Python, Spark, SQL, Pyspark, PowerBI etc.
  • You’ve got a background in software engineering, including Front End technologies like JavaScript.
  • You’re a problem-solver, pragmatically exploring options and finding effective solutions.
  • An understanding of how to design and build well-structured, maintainable systems.
  • Strong communication skills and a collaborative approach to work.
  • You embrace the chance to try new things, learn new skills and grow your experience.

It would be great if you have:

  • Experience of relevant cloud services within AWS, Azure or GCP.
  • Experience working in an Agile environment.
  • Experience working with common vendor products such as Snowflake or Data Bricks.
  • Experience working with CI/CD tooling.

What you’ll get in return is:

  • 25 days’ annual leave, rising to 30 days with each year of service.
  • Generous family leave policies.
  • Access to an employer pension scheme, private medical services and Group Life Assurance.
  • A range of optional benefits such as discounted gym membership and a cycle-to-work scheme.
  • A meaningful approach to evaluating your performance and providing feedback on your progress.

At Scott Logic, we value the flexibility of remote working alongside the value gained from spending time with our colleagues and clients. In our offices you’ll find employee-led clubs and events, as well as free games, books, and refreshments.

We have shared values that govern our behavior toward others and the environment. We are proud to be a B Corp, a global movement of businesses driving for a more inclusive, equitable, and regenerative economy.

#J-18808-Ljbffr

Lead Data Engineer employer: Scott Logic

At Scott Logic, we pride ourselves on being an exceptional employer, offering a dynamic work culture that fosters collaboration and innovation. With generous benefits including up to 30 days of annual leave, private medical services, and a commitment to employee growth through meaningful feedback, we empower our team to thrive both professionally and personally. Located in London, our hands-on roles allow for direct client engagement, ensuring that every day presents new challenges and opportunities to make a real impact in the tech landscape.
Scott Logic

Contact Detail:

Scott Logic Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Lead Data Engineer

✨Tip Number 1

Familiarise yourself with the specific technologies mentioned in the job description, such as Python, Spark, and SQL. Having hands-on experience or projects showcasing these skills can set you apart during interviews.

✨Tip Number 2

Demonstrate your problem-solving abilities by preparing examples of past challenges you've faced in data engineering. Be ready to discuss how you approached these issues and the solutions you implemented.

✨Tip Number 3

Since this role involves client interaction, practice articulating complex technical concepts in a simple manner. This will help you showcase your strong communication skills during the interview process.

✨Tip Number 4

Research the company’s values and culture, especially their commitment to being a B Corp. Aligning your personal values with theirs can be a great conversation starter and show that you're a good fit for their team.

We think you need these skills to ace Lead Data Engineer

Data Engineering
Python
SQL
Spark
Pyspark
PowerBI
JavaScript
Data Pipeline Development
Data Warehousing
Cloud Services (AWS, Azure, GCP)
Agile Methodologies
CI/CD Tooling
Problem-Solving Skills
Communication Skills
Team Leadership
System Design and Architecture

Some tips for your application 🫡

Tailor Your CV: Make sure your CV highlights your experience with data engineering technologies such as Python, Spark, SQL, and any relevant cloud services. Emphasise your software engineering background and problem-solving skills.

Craft a Compelling Cover Letter: In your cover letter, explain why you're interested in the Lead Data Engineer position and how your skills align with the company's needs. Mention your experience in building data platforms and your ability to lead teams.

Showcase Relevant Projects: Include specific examples of projects you've worked on that demonstrate your expertise in data pipelines, data lakes, and analytics solutions. Highlight any experience with Agile methodologies or CI/CD tooling.

Highlight Soft Skills: Since this role is client-facing, emphasise your strong communication skills and collaborative approach. Provide examples of how you've successfully worked with clients or led teams in the past.

How to prepare for a job interview at Scott Logic

✨Showcase Your Technical Skills

Be prepared to discuss your experience with technologies like Python, Spark, SQL, and PowerBI. Bring examples of projects where you've successfully built data pipelines or transformed datasets, as this will demonstrate your hands-on expertise.

✨Emphasise Problem-Solving Abilities

Highlight specific challenges you've faced in previous roles and how you approached solving them. This is crucial for a Lead Data Engineer role, as you'll be expected to tackle tough engineering challenges and provide effective solutions.

✨Demonstrate Communication Skills

Since the role is client-facing, strong communication skills are essential. Practice explaining complex technical concepts in simple terms, as you may need to advise clients or lead teams effectively.

✨Familiarise Yourself with Agile Methodologies

If you have experience working in an Agile environment, be ready to discuss it. Understanding Agile principles can set you apart, as it shows you're adaptable and can thrive in a collaborative setting.

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

>