Lead Data Engineer - Cloud Data Platform (AWS/Snowflake)

Lead Data Engineer - Cloud Data Platform (AWS/Snowflake)

Full-Time 80000 - 100000 £ / year (est.) Home office (partial)
London Stock Exchange

At a Glance

  • Tasks: Design and develop automated data pipelines on AWS and Snowflake.
  • Company: Join a leading financial services company driving data transformation.
  • Benefits: Competitive salary, flexible working, and opportunities for professional growth.
  • Other info: Dynamic team environment with a focus on innovation and career advancement.
  • Why this job: Be at the forefront of cloud technology and make a real impact in data management.
  • Qualifications: 10+ years in Python, 3+ years in data engineering, and experience with CI/CD pipelines.

The predicted salary is between 80000 - 100000 £ per year.

Requirements

  • Design and development of automated data pipelines and data structures.
  • 10+ years of working with Python Programming.
  • 3+ years hands-on data engineering experience for data warehouse solutions using Snowflake, SQL, dbt and Airflow.
  • 5+ years hands-on experience building Event stream processing systems on Kafka or similar technology and experience in building event-based services.
  • 2+ years hands-on knowledge of building CI/CD pipelines using GitLab.
  • 5+ years working with Agile Delivery teams (Scrum, Kanban) and JIRA.
  • Ability to build automated testing to test data pipelines.
  • Support transition from on-premises solutions to cloud-first strategy (AWS & Snowflake).
  • Up-to-date knowledge of technology standards, industry trends, emerging technologies and software development best practices.
  • Demonstrable experience of ITIL processes within a 2nd/3rd line support environment.

What the job involves

The Post Trade Division in LSEG has launched a Data Transformation program called Concorde. The objective is to have a new, centralized, and secure way to manage Post Trade data on cloud-native technology in AWS and Snowflake. The operating model is a federated model with Core Engineering teams based in London/Bucharest/Bangalore and Engineers based in each Business division to lead the implementation of tenancies on AWS/Snowflake.

As a Lead Data Engineer for Concorde you will be a key operational and hands-on engineer delivering Business tenancies for SwapClear and Listed Rates as part of the data platform strategy execution across all areas of the business. You will act as a member of the Concorde program and work with product teams across SwapClear and Listed Rates to design and implement modern, scalable data solutions using a range of new and emerging technologies contributing to innovation in the data space.

You will work on developing and supporting the AWS & Snowflake based cloud data platform as well as helping to support and migrate data from legacy platforms. This is an opportunity to play a key part in the roll-out of a new cloud-based analytics platform and the role would suit an ambitious individual keen to develop their skills and knowledge.

You will be a self-starter who is able to manage both business stakeholders and engineering teams across multiple locations.

Lead Data Engineer - Cloud Data Platform (AWS/Snowflake) employer: London Stock Exchange

As a Lead Data Engineer at LSEG, you will join a forward-thinking team dedicated to transforming Post Trade data management through innovative cloud solutions. Our collaborative work culture fosters continuous learning and professional growth, with ample opportunities to enhance your skills in cutting-edge technologies like AWS and Snowflake. Located in vibrant London, we offer a dynamic environment where your contributions directly impact our data strategy, making this an exciting place for those seeking meaningful and rewarding employment.

London Stock Exchange

Contact Details:

London Stock Exchange Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Lead Data Engineer - Cloud Data Platform (AWS/Snowflake)

Network Like a Pro

Get out there and connect with folks in the industry! Attend meetups, webinars, or even just grab a coffee with someone who’s already in the data engineering space. You never know who might have the inside scoop on job openings or can put in a good word for you.

Show Off Your Skills

When you get the chance to chat with potential employers, don’t hold back! Share your experiences with Python, Snowflake, and building CI/CD pipelines. Bring examples of your work or projects that highlight your expertise in data engineering. Let them see what you can do!

Tailor Your Approach

Every company is different, so make sure you tailor your conversations to fit their needs. Research LSEG and the Concorde program, and be ready to discuss how your skills can help them achieve their goals. Show them you’re not just another candidate, but the right fit for their team.

Apply Through Our Website

Don’t forget to apply through our website! It’s the best way to ensure your application gets seen by the right people. Plus, it shows you’re genuinely interested in joining our team and being part of the exciting work we’re doing in the cloud data platform space.

We think you need these skills to ace Lead Data Engineer - Cloud Data Platform (AWS/Snowflake)

Python Programming
Data Engineering
Snowflake
SQL
dbt
Airflow
Kafka

Some tips for your application 🫡

Tailor Your CV:Make sure your CV highlights your experience with Python, Snowflake, and data engineering. We want to see how your skills match the job description, so don’t be shy about showcasing relevant projects!

Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Tell us why you’re excited about the Lead Data Engineer role and how your background aligns with our goals at StudySmarter. Keep it engaging and personal!

Showcase Your Projects:If you've worked on any cool data pipelines or cloud solutions, make sure to mention them! We love seeing real-world examples of your work, especially if they involve AWS, Snowflake, or CI/CD pipelines.

Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you don’t miss out on any important updates from our team!

How to prepare for a job interview at London Stock Exchange

Know Your Tech Inside Out

Make sure you’re well-versed in the technologies mentioned in the job description, especially AWS, Snowflake, and Python. Brush up on your experience with data pipelines, CI/CD processes, and event stream processing systems. Being able to discuss specific projects where you've used these technologies will show your expertise.

Showcase Your Agile Experience

Since the role involves working with Agile teams, be prepared to share examples of how you've contributed to Agile delivery. Talk about your experiences with Scrum or Kanban, and how you’ve used tools like JIRA to manage tasks. This will demonstrate your ability to work collaboratively in a fast-paced environment.

Prepare for Scenario-Based Questions

Expect questions that assess your problem-solving skills, particularly around data pipeline automation and cloud migration. Think of scenarios where you faced challenges and how you overcame them. This will help interviewers see your critical thinking and technical abilities in action.

Demonstrate Your Leadership Skills

As a Lead Data Engineer, you'll need to manage stakeholders and engineering teams. Be ready to discuss your leadership style and provide examples of how you've successfully led projects or teams in the past. Highlight your ability to communicate effectively across different locations and teams.