At a Glance
- Tasks: Lead the design and development of data-driven software solutions for trading.
- Company: Join a large utility client focused on innovation in the European Trading sector.
- Benefits: Enjoy medical, dental, vision insurance, and 401k with employer matching after 31 days.
- Why this job: Shape quantitative strategies in a collaborative, agile environment while driving technological innovation.
- Qualifications: Expertise in Python, C#, .NET, Databricks, Azure, and strong problem-solving skills required.
- Other info: Work 3 days a week onsite in Mayfair, London, with opportunities for professional growth.
The predicted salary is between 48000 - 72000 £ per year.
A large utility client is seeking a highly skilled Senior Data Engineer to join their European Trading team. This role involves leading and participating in the design, development, testing, implementation, and maintenance of data-driven software solutions. The ideal candidate will possess expert-level knowledge of Python, C#, .NET, Databricks, and Azure, ensuring alignment with business objectives. They will identify and champion innovation in technology and processes to unlock new commercial opportunities. Collaborating closely with the trading team, the Senior Data Engineer will shape quantitative strategies and ensure data/analytics pipelines meet front-office needs. This position requires the ability to work independently with minimal guidance, exercising broad latitude in decision-making.
Key responsibilities include:
- Migrating an existing Python-based reporting/analytics application and its data workflows from Azure SQL to Databricks.
- Creating and optimizing data pipelines in Databricks.
- Leveraging scheduling, job orchestration, and optionally machine learning features to serve trading and analytics needs.
- Collaborating with quantitative analysts, traders, and commercial stakeholders to design new application features, dashboards, and analytics for portfolio management, pricing, and risk analysis.
- Supporting broader IT initiatives by ensuring compliance with corporate standards, best practices, and robust architectural design.
This position will be officially managed by the IT department but will work very closely with the trading team. It requires strong problem-solving skills, a willingness to learn new technologies and markets, and the ability to thrive in a highly collaborative, agile environment. Excellent communication and collaboration skills are essential, along with proven experience in the relevant technologies and processes.
This position is 3 days a week onsite in Mayfair, London. Benefit packages for this role will start on the 31st day of employment and include medical, dental, and vision insurance, as well as HSA, FSA, and DCFSA account options, and 401k retirement account access with employer matching.
Must Haves:
- Strong Python, C#, .NET development skills – proven ability to write efficient, production-quality code (e.g., data structures, error handling, code optimization).
- Proficiency in SQL – comfortable designing databases, writing complex queries, and handling performance tuning.
- Experience with Databricks (or a comparable Spark environment) – ability to build data pipelines, schedule jobs, and create dashboards/notebooks.
- Experience with Azure services (Data Factory, Synapse, or similar) and knowledge of cloud-based data solutions.
- Familiarity with version control (Git), CI/CD pipelines, and Agile/Scrum methodologies.
- Ability to communicate technical topics to non-technical stakeholders.
- Demonstrated problem-solving capabilities and willingness to learn new technologies, markets, and business concepts.
Plusses:
- Exposure to Dash Plotly (or similar Python frameworks like Streamlit) for dashboard creation.
- Experience with Machine Learning model development and data science workflows (including frameworks such as scikit-learn, PyTorch, or TensorFlow).
- Experience in Quantitative Finance or strong interest in mathematical/financial modeling, derivatives pricing, or algorithmic trading.
- Familiarity with ETRM platforms (e.g., OpenLink Endur).
- Master’s degree in computer science, Engineering, or a related technical field.
- Experience building highly scalable data applications in a cloud environment.
Senior Engineer, Data Engineering employer: Insight Global
Contact Detail:
Insight Global Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Senior Engineer, Data Engineering
✨Tip Number 1
Familiarise yourself with the specific technologies mentioned in the job description, such as Python, C#, .NET, Databricks, and Azure. Consider building a small project or contributing to open-source projects that utilise these technologies to demonstrate your hands-on experience.
✨Tip Number 2
Network with professionals in the data engineering field, especially those who work in trading or finance. Attend industry meetups or webinars to connect with potential colleagues and learn more about the challenges they face, which can help you tailor your approach during interviews.
✨Tip Number 3
Prepare to discuss your problem-solving skills and how you've applied them in previous roles. Think of specific examples where you identified a challenge and implemented a solution, particularly in data engineering or analytics contexts, as this will resonate well with the hiring team.
✨Tip Number 4
Showcase your ability to communicate complex technical topics to non-technical stakeholders. Practice explaining your past projects or experiences in simple terms, as this skill is crucial for collaborating with the trading team and other business units.
We think you need these skills to ace Senior Engineer, Data Engineering
Some tips for your application 🫡
Tailor Your CV: Make sure your CV highlights your experience with Python, C#, .NET, Databricks, and Azure. Use specific examples of projects where you have successfully implemented data-driven solutions, focusing on your role in design, development, and maintenance.
Craft a Compelling Cover Letter: In your cover letter, express your enthusiasm for the role and the company. Discuss how your skills align with the job requirements, particularly your ability to lead projects and collaborate with trading teams. Mention any relevant experience in quantitative finance or machine learning.
Showcase Problem-Solving Skills: Provide examples in your application that demonstrate your problem-solving capabilities. Describe specific challenges you've faced in previous roles and how you overcame them, especially in relation to data pipelines and analytics.
Highlight Communication Skills: Since the role requires communicating technical topics to non-technical stakeholders, include examples of how you've successfully conveyed complex information in an understandable way. This could be through presentations, reports, or collaborative projects.
How to prepare for a job interview at Insight Global
✨Showcase Your Technical Skills
Be prepared to discuss your experience with Python, C#, .NET, and Databricks in detail. Bring examples of your previous work, especially any data pipelines or applications you've developed, and be ready to explain the challenges you faced and how you overcame them.
✨Understand the Business Context
Research the utility sector and the specific trading team you'll be working with. Understanding their business objectives will help you align your technical skills with their needs, demonstrating that you can contribute to their goals effectively.
✨Prepare for Problem-Solving Questions
Expect to face scenario-based questions that assess your problem-solving abilities. Practice articulating your thought process when tackling complex issues, particularly those related to data workflows and analytics, as this role requires strong analytical skills.
✨Communicate Clearly with Non-Technical Stakeholders
Since the role involves collaboration with traders and commercial stakeholders, practice explaining technical concepts in simple terms. This will show your ability to bridge the gap between technical and non-technical teams, which is crucial for success in this position.