Lead Data Engineer

Are you a technologist who has a hunger to dig deep and get involved in providing first-class solutions to real-world problems?

Lead Data Engineer – London

First Derivative is a people-first company. We are powered by our ever-growing teams of specialist problem-solvers and process-evolvers. Our extensive capabilities offer agile solutions and exciting career opportunities – whether you're in the early stages of your career, looking for a new direction, or wanting to continue in a position of leadership.

Joining the world’s largest Capital Markets dedicated consultancy, you will have the opportunity to gain exposure to a range of mission-critical projects, tech stacks, clients and a company that prides itself on career development, variety, and flexibility.

We have opportunities for Mid-Senior Software Engineers who will work shoulder to shoulder with Tier 1 investment banks, including Morgan Stanley, UBS, Citigroup, JP Morgan and Credit Suisse to name a few.

What will you do?

The project entails the development of a robust Risk Data Platform built on Snowflake, leveraging AWS as the cloud infrastructure.

The platform will support multiple risk applications, incorporating tailored risk matrices for individual desks to ensure comprehensive and granular risk management. The integration will include a high-performance risk engine powered by Murex, facilitating advanced risk computations and analysis.

The scope covers the design, implementation, and testing of the platform to meet the specified requirements, ensuring scalability, security, and efficient data handling across all risk operations.

What experience will you need?

Essential Requirements:

• Experience in risk analytics, including market risk or credit risk.
• Familiarity with risk technology and calculations, including VaR, Stress Testing, Sensitivities, and P&L Vectors.
• Strong software development skills in Python or another common programming language (e.g., Java or Scala), with a focus on best practices: low-level design documentation, clean and well-documented code, and thorough testing.
• Expertise in Apache Airflow, with demonstrated experience designing, implementing, and managing workflows, DAGs, and tasks. A deep understanding of Airflow's architecture, best practices, and troubleshooting capabilities is mandatory.
• Proficiency in deploying and managing Cloud Database Services, with a preference for Snowflake.
• Advanced skills in SQL and Python for data manipulation and analysis.
• Experience implementing cloud-based solutions using modern cloud technologies (preferably AWS).
• Familiarity with modern SDLC tooling, including Git, Bamboo, Jira, or similar.
• Proven ability to implement and enforce data quality standards and practices.

Preferred Qualifications (Nice to Have):

• Good base of derivatives knowledge, pricing, risk management of structured products, options and more exotic derivatives.
• Knowledge of additional data processing libraries and tools to enhance data engineering workflows.
• Expertise in real-time data processing frameworks such as Apache Flink or Kafka Streams.
• Experience building event-driven and/or streaming data services.

Soft Skills:

• Strong analytical and problem-solving skills, with the ability to troubleshoot and resolve complex data-related issues effectively.
• Excellent communication skills, with the ability to collaborate and share knowledge within a team environment.
• Proactive, self-starter attitude with an entrepreneurial approach.
• Ability to escalate and follow up on issues promptly and efficiently.

What's in it for you?

You will embark upon a career with life-long learning at its core, facilitating rapid professional and personal development and the opportunity to design your own career path.

Benefits:

• Hybrid and Flexible Working
• Extensive Private Healthcare Package
• Private Pension
• Employee Assistance Programme
• Enhanced Maternity/ Paternity policies
• Group Life Protection Benefit
• Employee Referral Bonus Scheme
• Access to a range of skills and certifications such as GCP, AWS, Azure and more!

Additional Perks:

• FD Internal Network and Sports & Social Calendar, who host monthly and quarterly socials at each office.
• Aspiring LeadershipProgramme – a programme which provides a structured and practical pathway to fast-track talented individuals into leadership roles.
• STEP-up Awards – employee led awards designed to acknowledge excellence in four areas that are quintessential to us.
• TechSmiths Guild – helping employees get to grips with everything cloud computing and data storage (which are integral to the future of business and risk management).
• STRIVE Initiative and IMPACT Programme – development programmes put in place to support women in tech and financial services.
• Investment Club – employees learn the basics of investment and trading via workshops and competitions, mirroring real-life scenarios.
• Food Club – the opportunity to try out new cuisines together as a team
• Sports Club – a bit of healthy competition! Getting involved in 5k fun runs, JPM challenge and SCB challenge.