At a Glance
- Tasks: Lead a dynamic team in delivering top-notch data solutions and drive continuous improvement.
- Company: Join PEI Group, a global leader in business intelligence with a diverse and inclusive culture.
- Benefits: Enjoy flexible working arrangements, competitive salary, and opportunities for professional growth.
- Other info: Collaborative environment with a focus on innovation and career development.
- Why this job: Make a real impact in the data engineering field while mentoring the next generation of talent.
- Qualifications: 8+ years in data engineering, with strong leadership and technical skills.
The predicted salary is between 70000 - 90000 € per year.
As a Data Engineering Manager, you will provide technical and delivery leadership to a multi-disciplinary team of data engineers, QA engineers, data analysts, and Dynamics 365 developers. You will drive coding standards, delivery excellence, and continuous improvement across the data platform. This is a leadership-focused role with an 80% managerial and 20% hands-on split.
Roles and Responsibilities
- Collaborate with Product, Project, and Business stakeholders to plan, prioritise, and deliver data initiatives on time and to a high standard, with adherence to standard processes.
- Manage the delivery pipeline across multiple workstreams, balancing capacity, dependencies, and competing priorities while maintaining a high bar for quality.
- Own and enforce coding standards, pull request review policies, testing practices, and branching strategies across the team.
- Drive data quality, governance, and platform reliability — including data cataloguing, lineage tracking, PII handling, and data quality SLA ownership.
- Optimise data solutions for maintainability, quality, performance, security, and scalability.
- Provide technical leadership and direction across Databricks and Dynamics 365 workstreams, setting clear expectations and objectives for individuals and the wider team.
- Hire, mentor, and performance-manage engineers and analysts at all career levels, fostering growth, accountability, and a culture of continuous learning.
- Collaborate cross-functionally with data science, product, finance, and business operations teams to deliver data-driven solutions.
- Contribute hands-on through architecture reviews, code reviews, prototyping, and debugging complex production issues — leading by example and staying close to the technology without being on the critical path.
- Drive a continuous improvement process — introduce tooling, automation, and process changes grounded in real data analysis and team feedback.
- Research and evaluate new technologies and trends in data engineering, recommending pragmatic improvements and innovations.
- Prioritise and manage ad-hoc requests in parallel with ongoing projects.
About You
Requirements:
- Qualification & Experience
- 8+ years of hands-on experience in data engineering or software development, with significant exposure to data platforms and pipelines.
- A minimum of 3 years of people management experience; has built and operated teams of highly skilled engineers and analysts.
- Experience with hiring, mentoring, upskilling, and performance management.
- Proven track record of successfully managing and leading multi-disciplinary engineering teams.
- Solid understanding of the software and data delivery lifecycle.
Technical Skills
- Strong experience with Databricks (PySpark/Spark SQL, Delta Lake, Unity Catalog, medallion architecture, Databricks Workflows).
- Working knowledge of Microsoft Dynamics 365 data structures, Dataverse, and common integration patterns (Synapse Link for Dataverse, Dataverse APIs).
- Solid understanding of the Azure data ecosystem (Azure Data Factory, ADLS Gen2, Azure DevOps, Key Vault).
- Strong grasp of testing methodologies, CI/CD pipelines, and data quality automation.
- Experience embedding data governance practices — cataloguing, lineage, RBAC, and regulatory compliance (e.g. GDPR).
Personal Attributes
- Exceptional delivery management skills, including planning, executing, and delivering complex data projects across multiple workstreams.
- Ability to operate in an Agile environment with a start-up mentality and comfort in an evolving, unstructured environment.
- Must be a compelling and clear communicator, able to represent the team to internal and external audiences with differing levels of technical fluency.
- Driving a high-performance, collaborative, and inclusive team culture in a fast-paced environment.
About Us
PEI Group is a subscriber-focused business intelligence company. With our multi-talented global team of over 490 people, spread across EMEA, USA & Asia, our purpose is to inform and connect investment professionals across global, specialised markets. We identify specific high growth, high value investment sectors and themes where deep insight, strong market relationships and active capital flows are critical for success.
PEI Group provides industry-leading journalism, data, and market insight to subscribing clients via a wide portfolio of specialist brands supported by our robust and scalable digital publishing, analytics, and database platform. We also track the firms and individuals who shape markets and bring client-communities together to enable knowledge sharing, profile building and relationship development through professional networks and events.
At PEI we value diverse talent and welcome applications from everyone – regardless of background. We are an equal opportunity employer and our inclusive culture at PEI is reflected in every stage of the recruitment journey. Please inform us at initial stages of the recruitment process if you require any reasonable adjustments and we can accommodate this.
PEI Group supports flexible working arrangements, and we welcome career returners.
Data Engineering Manager in City of London employer: PEI Group
PEI Group is an exceptional employer that fosters a collaborative and inclusive work culture, providing ample opportunities for professional growth and development. As a Data Engineering Manager, you will lead a talented team in a dynamic environment, driving innovation and excellence while enjoying the benefits of flexible working arrangements and a commitment to diversity. With a focus on continuous improvement and cutting-edge technology, PEI Group empowers its employees to make a meaningful impact in the investment intelligence sector.
StudySmarter Expert Advice🤫
We think this is how you could land Data Engineering Manager in City of London
✨Tip Number 1
Network like a pro! Reach out to your connections in the data engineering field and let them know you're on the lookout for opportunities. A personal recommendation can go a long way in landing that interview.
✨Tip Number 2
Prepare for those interviews by brushing up on your technical skills and leadership experience. Be ready to discuss how you've driven coding standards and managed teams effectively, as these are key aspects of the role.
✨Tip Number 3
Showcase your hands-on experience! Be prepared to share examples of how you've contributed to data platforms and pipelines, especially with tools like Databricks and Dynamics 365. Real-world examples can set you apart.
✨Tip Number 4
Don't forget to apply through our website! It’s the best way to ensure your application gets the attention it deserves. Plus, we love seeing candidates who take the initiative to connect directly with us.
We think you need these skills to ace Data Engineering Manager in City of London
Some tips for your application 🫡
Tailor Your CV:Make sure your CV reflects the skills and experiences that match the Data Engineering Manager role. Highlight your leadership experience and technical expertise in data platforms, as we want to see how you can drive our team forward.
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to tell us why you're passionate about data engineering and how your background aligns with our mission at PEI Group. Be sure to mention any relevant projects or achievements.
Showcase Your Leadership Style:Since this role is heavily focused on management, share examples of how you've successfully led teams in the past. We love to see how you foster growth and accountability among your team members!
Apply Through Our Website:We encourage you to apply directly through our website for the best chance of getting noticed. It’s the easiest way for us to keep track of your application and ensure it reaches the right people!
How to prepare for a job interview at PEI Group
✨Know Your Tech Inside Out
As a Data Engineering Manager, you'll need to demonstrate your expertise in Databricks and the Azure ecosystem. Brush up on your knowledge of PySpark, Delta Lake, and CI/CD pipelines. Be ready to discuss how you've applied these technologies in past projects.
✨Showcase Your Leadership Skills
This role is heavily focused on people management, so be prepared to share examples of how you've successfully led multi-disciplinary teams. Talk about your experience in hiring, mentoring, and fostering a culture of continuous learning within your teams.
✨Prepare for Scenario-Based Questions
Expect questions that assess your problem-solving abilities and decision-making skills. Think of specific scenarios where you had to manage competing priorities or drive data quality improvements, and be ready to explain your thought process and outcomes.
✨Communicate Clearly and Confidently
You'll need to represent your team to various stakeholders, so practice articulating complex technical concepts in a way that's easy to understand. Highlight your exceptional communication skills and how they’ve helped bridge gaps between technical and non-technical teams.
