Data Engineering

Overview

This role focuses on enhancing and maintaining data pipelines to process financial and ESG data. The role will design, build, and maintain robust data pipelines using Snowflake, Dagster, and SQL to handle terabytes of data, ensuring pipelines are efficient and reliable.

Responsibilities

• Design, build, and maintain robust data pipelines using Snowflake, Dagster, and SQL to process financial, climate, and ESG datasets at scale.
• Collaborate with the Climate Risk modeling team to integrate advanced economic models into production environments.
• Leverage automation tools like GitHub to streamline deployment and enable rapid iteration.
• Uphold high technical standards by implementing best practices in coding, testing, and documentation; regularly review and improve the codebase to incorporate new learnings.
• Work within an agile framework to prioritize tasks, manage time effectively, and align with team goals; act as a proactive contributor to cross-functional collaboration with data scientists, analysts, and other stakeholders.

Qualifications

• Degree in computer science, engineering, mathematics, quantitative methods or related field.
• Substantial experience in developing and maintaining production-level data pipelines.
• Strong command of Python, with a focus on clean, efficient, production-ready code.
• Strong SQL expertise with relational databases such as PostgreSQL or Snowflake.
• Substantial experience with core AWS products such as EC2, ECS, Lambda and RDS.
• Familiarity with data orchestration technologies such as Dagster, or a strong desire to learn.
• Familiarity with DBT or similar tools for data transformation, or a strong desire to learn.
• Passion for automation, with experience in containerisation (Docker), shell scripting, and CI/CD pipelines.
• Knowledge of software engineering best practices across the development lifecycle, including agile methodologies, coding standards, peer code reviews, version control, build processes, testing, and deployment.
• Excellent written and verbal communication skills.

About us and Inclusion

SLR are global leaders in Sustainability Solutions, helping clients achieve sustainability goals. We are a consultancy with 4500+ employees across 6 regions in over 125 countries. Our culture emphasizes collaboration and professional development. We are committed to equal opportunity and foster an inclusive environment where all people can thrive. We welcome applications from all individuals, including those from groups that are currently under-represented, such as 2SLGBTQI+, Indigenous peoples, ethnic minority groups, women, and people with visible or invisible disabilities, including those who are neurodivergent.