Data Engineer - Quanteam

Job: DATA ENGINEER

Location: London – Hybrid working

Full Time Contract – Long term engagement

Job Summary

We are seeking a highly skilled Data Engineer with expertise in Databricks, Apache Spark, and Scala/Python to join our dynamic team in London on a contingent worker basis. The ideal candidate will have hands-on experience in data engineering, along with experience or a strong understanding of data governance. You will play a key role in designing and implementing robust data pipelines and ensuring compliance with data governance best practices.

Key Responsibilities:

• Develop, optimize, and maintain big data pipelines using Databricks and Apache Spark.
• Write efficient, scalable, and maintainable Scala/Python code for data processing and transformation.
• Collaborate with data architects, analysts, and business teams to understand data requirements.
• Ensure data quality, lineage, and security within data platforms.
• Work with structured and unstructured data from multiple sources, integrating them into a unified data lake.
• Optimize performance of big data workflows and troubleshoot data processing issues.
• Document technical processes, best practices, and governance policies.

Key Requirements:

• 5+ years of experience in data engineering with a focus on Databricks and Apache Spark.
• Strong programming skills in Scala and/or Python.
• Experience or a strong understanding of data governance, metadata management, and regulatory compliance.
• Knowledge of cloud platforms (Azure, AWS, or GCP) for big data processing.
• Experience with Delta Lake, Lakehouse architecture, and data cataloging.
• Strong understanding of ETL/ELT pipelines, SQL, and NoSQL databases.
• Familiarity with data security, privacy standards (GDPR, ISO, etc.), and access controls.
• Excellent problem-solving and communication skills.
• Banking Experience is must

WHO WE ARE

Quanteam Group is a Consulting firm specialized in the Capital Markets industry, in Paris, London, Krakow, Brussels, New York and North Africa.

Since 2007, our 800 consultants provide major clients (Corporate & Investment Banks, Asset Managers, Hedge Funds, Brokers and Insurance Companies) with expertise in several projects such as Financial Engineering, Quantitative Research, Regulatory Implementation, IT Transformation & Innovation.

The firm mainly takes part in:

• Business consulting: Quantitative research, Risk management (e.g. Market risk, credit risk, counterparty risk), Banking regulations (e.g. Basel III, Solvency II, FATCA, EMIR, MiFID), Pricing & Valuation, Organizational Transformation & Process Improvement.
• IT & Information systems consulting: Business Analysis, Project Management, Change management, Front Office Support (functional and technical), Development (e.g C++, Python, C#, Java, VBA), Financial Software (e.g. Sophis, Murex, Summit, Calypso), IT Transformation & Innovation.

As part of Quanteam Group, Quanteam UK & PL has today more than 80 consultants, working for major Capital Markets institutions in London and Krakow.