At a Glance
- Tasks: Design and develop scalable data pipelines using Python, PySpark, and SQL.
- Company: Join a major global banking organisation focused on data technology growth.
- Benefits: Competitive daily rate, hybrid work model, and potential for contract extension.
- Other info: Collaborative environment with opportunities for professional growth in a fast-paced setting.
- Why this job: Work on enterprise-grade data platforms and tackle complex data challenges.
- Qualifications: Strong experience in Data Engineering with Hadoop, Cloudera, and Python skills.
Location: Sheffield (Hybrid 3 days per week preferred)
c.£600 per day Inside IR35
Initial 6-month contract with strong likelihood of extension.
We are supporting a major global banking organisation on the growth of its Data Technology function and are looking for an experienced Data Engineer to join a large-scale data transformation programme. This is an excellent opportunity to work on enterprise-grade data platforms, building and enhancing data pipelines that support critical business and regulatory functions across a complex global environment.
Please note this role is aligned to the bank's Sheffield office, therefore there is a preference for individuals who would be able to travel to this location, if they are not already based in the local area.
Key Responsibilities:- Design, develop and maintain scalable data pipelines and ETL processes
- Develop robust solutions using Python, PySpark and SQL
- Work with large-scale datasets in distributed data environments
- Develop and support data solutions within on-prem Hadoop / Cloudera environments
- Support data ingestion, transformation and processing across Hadoop Data Lake platforms
- Contribute to data modelling and data warehousing initiatives
- Support CI/CD and automation practices across the data engineering lifecycle
- Collaborate with business stakeholders, architects and engineering teams to deliver high-quality data solutions
- Ensure data quality, performance and reliability across data platforms
- Strong commercial experience in Data Engineering
- Strong hands-on experience with Hadoop / Cloudera CDH on an on-premises platform
- Experience with Hadoop ecosystem technologies such as HDFS, Hive, Impala, Sqoop, YARN and/or MapReduce
- Excellent Python and PySpark development skills
- Advanced SQL knowledge
- Experience building and maintaining data pipelines and ETL solutions
- Good understanding of data warehousing and data modelling concepts
- Experience working within large-scale enterprise environments
- CI/CD experience
- Jenkins
- Ansible
- SAS
- Experience working with distributed systems and cloud-based data platforms
- Financial services or banking sector experience
The successful candidate will be a hands-on Data Engineer who enjoys solving complex data challenges and can quickly contribute within a fast-paced, delivery-focused environment.
Data Engineer Hadoop / Cloudera / PySpark / Python in City of London employer: Essential Consulting
Join a leading global banking organisation in Sheffield, where you will be part of a dynamic team driving significant data transformation initiatives. With a strong focus on employee growth and development, the company offers a collaborative work culture that values innovation and excellence, alongside competitive compensation and flexible hybrid working arrangements. This role not only provides the opportunity to work with cutting-edge technologies but also to contribute to critical business functions in a supportive environment that prioritises your professional advancement.
StudySmarter Expert Advice🤫
We think this is how you could land Data Engineer Hadoop / Cloudera / PySpark / Python in City of London
✨Network Like a Pro
Get out there and connect with people in the industry! Attend meetups, webinars, or even local tech events. You never know who might have a lead on that perfect Data Engineer role.
✨Show Off Your Skills
Create a portfolio showcasing your projects, especially those involving Hadoop, PySpark, and Python. Having tangible examples of your work can really set you apart during interviews.
✨Ace the Interview
Prepare for technical interviews by brushing up on your SQL and data pipeline skills. Practice common interview questions and be ready to discuss your experience with data solutions in detail.
✨Apply Through Us!
Don’t forget to check out our website for the latest job openings. Applying through us gives you a better chance to land that Data Engineer gig, so make sure to take advantage of it!
We think you need these skills to ace Data Engineer Hadoop / Cloudera / PySpark / Python in City of London
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights your experience with Hadoop, Cloudera, and Python. We want to see how your skills match the job description, so don’t be shy about showcasing your relevant projects and achievements!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re the perfect fit for this Data Engineer role. We love seeing enthusiasm and a clear understanding of the responsibilities outlined in the job description.
Showcase Your Technical Skills:When filling out your application, make sure to mention your hands-on experience with PySpark, SQL, and data pipelines. We’re looking for someone who can hit the ground running, so let us know what you’ve done in these areas!
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for this exciting opportunity. Don’t miss out!
How to prepare for a job interview at Essential Consulting
✨Know Your Tech Stack
Make sure you brush up on your knowledge of Hadoop, Cloudera, PySpark, and Python. Be ready to discuss specific projects where you've used these technologies, as well as any challenges you faced and how you overcame them.
✨Showcase Your Problem-Solving Skills
Prepare to talk about complex data challenges you've tackled in the past. Use the STAR method (Situation, Task, Action, Result) to structure your answers and highlight your analytical thinking and technical skills.
✨Understand the Business Context
Since this role is within a banking organisation, it’s crucial to understand how data engineering supports business and regulatory functions. Familiarise yourself with the financial services sector and be ready to discuss how your work can impact the organisation's goals.
✨Ask Insightful Questions
Prepare thoughtful questions about the team, the data transformation programme, and the technologies they use. This shows your genuine interest in the role and helps you assess if it's the right fit for you.
