Data Engineer (Senior)

Data Engineer (Senior)

London Full-Time 48000 - 72000 £ / year (est.) No home office possible
Go Premium
O

At a Glance

  • Tasks: Design and build operational pipelines for energy data across Octopus Energy regions.
  • Company: Join Octopus Energy, a leader in the transition to Net Zero energy solutions.
  • Benefits: Enjoy flexible working options, a collaborative culture, and opportunities for travel across Europe and the US.
  • Why this job: Be part of a mission-driven team focused on sustainable energy and innovative data solutions.
  • Qualifications: Strong skills in SQL, Python, and experience with tools like Kubernetes and Docker are essential.
  • Other info: Opportunity to enhance your skills while contributing to a greener future.

The predicted salary is between 48000 - 72000 £ per year.

The Energy Markets team at Octopus Energy is responsible for making sure that we always have the electricity and gas we need to support our customer demand whilst also supporting the grid to enable the Net Zero transition. To achieve this mission across all Octopus international regions, we have sub-teams focused on forecasting energy demand and generation, hedging and shaping our trade position, tracking and reporting the ongoing risk to Octopus, and driving the proportion of our supply directly from generators via PPA agreements. The Engineering sub-team owns our global technical platform that supports these different processes and drives forward long-term solutions to enhance Group capabilities.

We are looking for a Data Engineer to help achieve this goal - ideally someone who is comfortable diving into different tasks to support each team using a variety of coding languages across our platform setup, who enjoys developing relationships across the company while explaining technical processes in the most appropriate way, and who keeps an eye on scalable solutions to support data growth. This is therefore an exciting opportunity to take on a role that combines complex data engineering, visual analytics and business critical need.

What you'll do...

  • Supporting different Energy Markets teams to design and build key operational and reporting pipelines across all Octopus Energy regions;
  • Taking responsibility for the maintenance of these critical data pipelines supporting core trading, forecasting, risk and PPA processes;
  • Developing automations and alerts to quickly debug where these pipelines are failing or showing unprecedented trends;
  • Setting up and maintaining processes for capturing, preparing and loading valuable new data into the data lake;
  • Designing and building dashboards that cover operational processes and reporting requirements;
  • Working with international teams across the Octopus Energy Group to ensure everyone shares the best possible practices and code is standardized where possible;
  • Taking ownership of data platform improvements that enhance the capabilities for all Energy Markets teams and drives trust in the stability of the setup;
  • Sharing, enhancing and upskilling team members on available tools and best practices.

What you'll need...

  • Strong aptitude with SQL, Python and Airflow;
  • Experience in Kubernetes, Docker, Django, Spark and related monitoring tools for DevOps a big plus (e.g. Grafana, Prometheus);
  • Experience with dbt for pipeline modeling also beneficial;
  • Skilled at shaping needs into a solid set of requirements and designing scalable solutions to meet them;
  • Able to quickly understand new domain areas and visualize data effectively;
  • Team player excited at the idea of ownership across lots of different projects and tools;
  • Passion for driving towards Net Zero;
  • Drives knowledge sharing and documentation for a more effective platform;
  • Open to traveling to Octopus offices across Europe and the US.

Our Data Stack:

  • SQL-based pipelines built with dbt on Databricks
  • Analysis via Python Jupyter notebooks
  • Pyspark in Databricks workflows for heavy lifting
  • Streamlit and Python for dashboarding
  • Airflow DAGs with Python for ETL running on Kubernetes and Docker
  • Django for custom app/database development
  • Kubernetes for container management, with Grafana/Prometheus for monitoring
  • Hugo/Markdown for data documentation

Data Engineer (Senior) employer: Octopus Group

At Octopus Energy, we pride ourselves on being an exceptional employer that fosters a collaborative and innovative work culture. As a Senior Data Engineer, you will have the opportunity to work on impactful projects that contribute to the Net Zero transition while enjoying a supportive environment that encourages professional growth and knowledge sharing. With a focus on employee development and a commitment to sustainability, our team is dedicated to creating meaningful solutions in the energy sector across our international locations.
O

Contact Detail:

Octopus Group Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Data Engineer (Senior)

✨Tip Number 1

Familiarise yourself with the specific technologies mentioned in the job description, such as SQL, Python, and Airflow. Consider building a small project or contributing to an open-source project that uses these tools to demonstrate your hands-on experience.

✨Tip Number 2

Network with current or former employees of Octopus Energy on platforms like LinkedIn. Engaging in conversations about their experiences can provide you with valuable insights into the company culture and expectations for the Data Engineer role.

✨Tip Number 3

Prepare to discuss how you've previously tackled complex data engineering challenges. Be ready to share specific examples of how you've designed scalable solutions or improved data pipelines, as this will showcase your problem-solving skills.

✨Tip Number 4

Show your passion for the Net Zero transition by staying updated on industry trends and innovations. Being able to articulate your commitment to sustainability during interviews can set you apart from other candidates.

We think you need these skills to ace Data Engineer (Senior)

SQL
Python
Apache Airflow
Kubernetes
Docker
Django
Apache Spark
Data Pipeline Development
Data Lake Management
Dashboard Design
Data Visualisation
DevOps Monitoring Tools (Grafana, Prometheus)
dbt for Pipeline Modelling
Automation and Alerting
Requirements Gathering
Team Collaboration
Knowledge Sharing
Documentation Skills
Adaptability to New Domains
Passion for Net Zero Initiatives

Some tips for your application 🫡

Tailor Your CV: Make sure your CV highlights relevant experience with SQL, Python, and Airflow. Include specific projects where you've designed and built data pipelines or dashboards, as well as any experience with Kubernetes, Docker, or dbt.

Craft a Compelling Cover Letter: In your cover letter, express your passion for the energy sector and the Net Zero transition. Discuss how your skills align with the responsibilities of the Data Engineer role and provide examples of how you've successfully collaborated with teams in the past.

Showcase Technical Skills: Be sure to mention your proficiency in the tools and technologies listed in the job description, such as Pyspark, Streamlit, and Airflow. If you have experience with monitoring tools like Grafana or Prometheus, highlight that as well.

Demonstrate Problem-Solving Abilities: Include examples in your application that demonstrate your ability to troubleshoot and debug data pipelines. Discuss any automations or alerts you've developed to enhance operational efficiency in previous roles.

How to prepare for a job interview at Octopus Group

✨Showcase Your Technical Skills

Be prepared to discuss your experience with SQL, Python, and Airflow in detail. Highlight specific projects where you've used these technologies to solve complex problems, as this will demonstrate your capability to handle the technical demands of the role.

✨Understand the Energy Sector

Familiarise yourself with the energy markets and the importance of data engineering in supporting Net Zero initiatives. Showing that you understand the broader context of the role will impress interviewers and demonstrate your commitment to the company's mission.

✨Prepare for Scenario-Based Questions

Expect questions that assess your problem-solving skills, particularly around designing scalable solutions and debugging data pipelines. Practising how you would approach these scenarios can help you articulate your thought process clearly during the interview.

✨Emphasise Team Collaboration

Since the role involves working with various teams, be ready to discuss your experience in collaborative environments. Share examples of how you've effectively communicated technical processes to non-technical stakeholders and contributed to team success.

Data Engineer (Senior)
Octopus Group
Location: London
Go Premium

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

O
Similar positions in other companies
UK’s top job board for Gen Z
discover-jobs-cta
Discover now
>