Principal Data Engineer in London

LSEG (London Stock Exchange Group) is more than a diversified global financial markets infrastructure and data business. We are dedicated, open-access partners with a dedication to excellence in delivering the services our customers expect from us. With extensive experience, deep knowledge and worldwide presence across financial markets, we enable businesses and economies around the world to fund innovation, manage risk and create jobs.

Our People: People are at the heart of what we do and drive the success of our business. Our culture of connecting, creating opportunity and delivering excellence shape how we think, how we do things and how we help our people fulfil their potential. We embrace diversity and actively seek to attract individuals with unique backgrounds and perspectives. We break down barriers and encourage teamwork, enabling innovation and rapid development of solutions that make a difference.

Role Profile: Our Snowflake infrastructure is critical to the organization, and it’s essential that every Principal Data Engineer drives improvements in the design and build quality of our data platforms. This role involves close collaboration with data scientists, analysts, and BI teams to deliver robust, scalable, and high-performance data solutions.

The successful candidate will be responsible for:

• Identifying, designing, and implementing internal process improvements including redesigning infrastructure for greater scalability, optimizing data delivery, and automating manual processes.
• Maintaining the Landing Zone (LZ) and template to keep pace with the frequency of Snowflake change.
• Assembling large, sophisticated sets of data that meet non-functional and functional business requirements.
• Building required infrastructure for efficient extraction, transformation and loading of data from various data sources.
• Building analytical tools to use the data pipeline, providing actionable insight into key business performance metrics.
• Working with stakeholders including the Executive, Product, Data and Design teams to support their data infrastructure while assisting with data-related technical issues.
• Reduce risk by continuously introducing automation over processes which require human intervention.
• Lead historical cost allocation of the existing data stack and forecast costs as the business continues to grow and new deployments adopt the platform.
• Seek opportunities to engage the business on how to improve cost / performance ratios.
• Ensure all work is documented, conforming to security, infrastructure, product and other internal requirements.
• Contribute to the Snowflake Centre for Enablement delivering: a) Preferred integration patterns and standards; b) Advice, mentorship and assistance to partner teams; c) Evolving our company policies and standards.

Candidate Profile / Key skills:

• Minimum 10 years of industry experience, preferably in financial services.
• Hands-on experience with Snowflake (including administration) is an essential requirement for this role.
• Strong SQL skills for querying and optimizing data within Snowflake.
• Proven skills in cost optimization techniques.
• Hands-on experience with modern data engineering tools and frameworks such as dbt (data transformation), Apache Airflow (workflow orchestration), and streaming technologies like Apache Kafka.
• Hands-on experience of scripting languages (Python, Shell Script etc) for automation of tasks and processes.
• Good understanding of data through previous hands-on contributions to design, development, and implementation of IT systems.
• Familiarity with cloud platforms, as Snowflake is often deployed on popular cloud providers like AWS, Azure, or Google Cloud Platform.
• Good Understanding of automating infrastructure provisioning via Terraform, DevOps skills.
• Previous experience in Docker, Gitlab, Jenkins is advantageous.
• Excellent communication and interpersonal skills.
• Proactive, determined, and resilient, with a positive attitude.
• Extensive and demonstrable problem-solving and decision-making capabilities.
• Nice to have AWS, Snowflake certifications.

Career Stage: Manager

Join us and be part of a team that values innovation, quality, and continuous improvement. If you’re ready to take your career to the next level and make a significant impact, we’d love to hear from you.

LSEG is a leading global financial markets infrastructure and data provider. Our purpose is driving financial stability, empowering economies and enabling customers to create sustainable growth.

We are proud to be an equal opportunities employer. This means that we do not discriminate on the basis of anyone’s race, religion, colour, national origin, gender, sexual orientation, gender identity, gender expression, age, marital status, veteran status, pregnancy or disability, or any other basis protected under applicable law.