Lead Apache Hadoop Engineer | London, UK

Our Technology, Data, and Innovation (TDI) strategy aims to enhance engineering capabilities, implement an agile delivery framework, and modernize the bank's IT infrastructure. We are committed to investing in and developing a team of forward-thinking technology professionals, offering them the training, autonomy, and opportunities necessary to engage in groundbreaking work.

As a Lead Apache Hadoop Engineer, you will oversee the comprehensive delivery of engineering solutions to meet business objectives. In RiskFinder, you will join a local team, collaborating with other teams in your area. You will have the chance to architect, design, and implement an open-source big data platform, enabling clients to produce, access, and analyse extensive datasets through our custom components and applications.

You will be tasked with the comprehensive platform engineering and migration strategy for big data applications. The ideal candidate will possess substantial hands-on experience with both on-premise and cloud-based ecosystems, Open-Source Apache Projects, Kubernetes, and security protocols. This role demands a proactive senior individual capable of collaborating with global teams to address significant obstacles and facilitate large-scale migrations for critical applications.

What we’ll offer you:

• Hybrid Working - we understand that employee expectations and preferences are changing. We have implemented a model that enables eligible employees to work remotely for a part of their working time and reach a working pattern that works for them.
• Competitive salary and non-contributory pension.
• 30 days' holiday plus bank holidays, with the option to purchase additional days.
• Life Assurance and Private Healthcare for you and your family.
• A range of flexible benefits including Retail Discounts, a Bike4Work scheme and Gym benefits.
• The opportunity to support a wide-ranging CSR programme + 2 days' volunteering leave per year.

Your key responsibilities:

• Develop robust architectures and designs for big data platform and applications within the Apache Hadoop ecosystem.
• Implement and deploy big data platform and solutions on-premises and in hybrid cloud environments.
• Read, understand, and modify open-source code to implement bug fixes and perform upgrades.
• Address and resolve major blocker issues during application migration and contribute to defining the end-to-end platform engineering and application migration strategy.

Your skills and experience:

• Bachelor's or Master's degree in Computer Science, Engineering, or related field or equivalent experience.
• Highly proficient in Java and associated build frameworks such as Maven, Bower and SBT.
• Proven experience in architecting, designing, building, and deploying big data applications using the Apache Hadoop ecosystem in hybrid cloud and private cloud scenarios.
• Expert knowledge of Apache Hadoop ecosystem HDFS, Hive, HBase, Spark, Ranger, Kafka, Yarn etc.
• Proficiency in Kubernetes & Docker.
• Strong understanding of security practices within big data environments such as Kerberos, LDAP, POSIX and SSL.
• Ability to read and modify open-source Java and associated repositories.

How we’ll support you:

A culture of continuous learning to aid progression. We value diversity and as an equal opportunities employer, we make reasonable adjustments for those with a disability such as the provision of assistive equipment if required (e.g. screen readers, assistive hearing devices, adapted keyboards).

About us:

Deutsche Bank is the leading German bank with strong European roots and a global network. Deutsche Bank in the UK is proud to have been named in The Times Top 50 Employers for Gender Equality 2024 for five consecutive years. Additionally, we have been awarded a Gold Award from Stonewall and named in their Top 100 Employers 2024 for our work supporting LGBTQ+ inclusion.

We strive for a culture in which we are empowered to excel together every day. This includes acting responsibly, thinking commercially, taking initiative and working collaboratively. Together we share and celebrate the successes of our people. Together we are Deutsche Bank Group.

We welcome applications from all people and promote a positive, fair and inclusive work environment.