At a Glance
- Tasks: Design and develop scalable data pipelines using Python, PySpark, and SQL.
- Company: Join a major global banking organisation focused on data technology growth.
- Benefits: Competitive daily rate, hybrid work model, and potential for contract extension.
- Other info: Collaborative environment with opportunities for professional growth in a fast-paced setting.
- Why this job: Work on enterprise-grade data platforms and tackle complex data challenges.
- Qualifications: Strong experience in Data Engineering with Hadoop, Cloudera, and Python skills.
Location: Sheffield (Hybrid 3 days per week preferred)
c.£600 per day Inside IR35
Initial 6-month contract with strong likelihood of extension.
We are supporting a major global banking organisation on the growth of its Data Technology function and are looking for an experienced Data Engineer to join a large-scale data transformation programme. This is an excellent opportunity to work on enterprise-grade data platforms, building and enhancing data pipelines that support critical business and regulatory functions across a complex global environment.
Please note this role is aligned to the bank's Sheffield office, therefore there is a preference for individuals who would be able to travel to this location, if they are not already based in the local area.
Key Responsibilities:- Design, develop and maintain scalable data pipelines and ETL processes
- Develop robust solutions using Python, PySpark and SQL
- Work with large-scale datasets in distributed data environments
- Develop and support data solutions within on-prem Hadoop / Cloudera environments
- Support data ingestion, transformation and processing across Hadoop Data Lake platforms
- Contribute to data modelling and data warehousing initiatives
- Support CI/CD and automation practices across the data engineering lifecycle
- Collaborate with business stakeholders, architects and engineering teams to deliver high-quality data solutions
- Ensure data quality, performance and reliability across data platforms
- Strong commercial experience in Data Engineering
- Strong hands-on experience with Hadoop / Cloudera CDH on an on-premises platform
- Experience with Hadoop ecosystem technologies such as HDFS, Hive, Impala, Sqoop, YARN and/or MapReduce
- Excellent Python and PySpark development skills
- Advanced SQL knowledge
- Experience building and maintaining data pipelines and ETL solutions
- Good understanding of data warehousing and data modelling concepts
- Experience working within large-scale enterprise environments
- CI/CD experience
- Jenkins
- Ansible
- SAS
- Experience working with distributed systems and cloud-based data platforms
- Financial services or banking sector experience
The successful candidate will be a hands-on Data Engineer who enjoys solving complex data challenges and can quickly contribute within a fast-paced, delivery-focused environment.
Data Engineer Hadoop / Cloudera / PySpark / Python in Sheffield employer: Essential Consulting
Join a leading global banking organisation in Sheffield, where you will be part of a dynamic team driving significant data transformation initiatives. With a strong focus on employee growth and development, the company offers a collaborative work culture that values innovation and excellence, alongside competitive compensation and flexible hybrid working arrangements. This role not only provides the opportunity to work with cutting-edge technologies but also to contribute to impactful projects that shape the future of banking.
StudySmarter Expert Advice🤫
We think this is how you could land Data Engineer Hadoop / Cloudera / PySpark / Python in Sheffield
✨Tip Number 1
Network like a pro! Reach out to your connections in the data engineering field, especially those who work in banking or have experience with Hadoop and Cloudera. A friendly chat can lead to insider info about job openings that aren't even advertised yet.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your projects with Python, PySpark, and any data pipelines you've built. This is your chance to demonstrate your hands-on experience and make a lasting impression during interviews.
✨Tip Number 3
Prepare for technical interviews by brushing up on your SQL and data modelling concepts. Practice common data engineering problems and be ready to discuss your approach to building scalable data solutions. Confidence is key!
✨Tip Number 4
Don't forget to apply through our website! We’ve got loads of opportunities that match your skills. Plus, applying directly shows your enthusiasm and commitment to joining our team. Let’s get you that dream job!
We think you need these skills to ace Data Engineer Hadoop / Cloudera / PySpark / Python in Sheffield
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights your experience with Hadoop, Cloudera, and Python. We want to see how your skills match the job description, so don’t be shy about showcasing your relevant projects and achievements!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re the perfect fit for this Data Engineer role. We love seeing enthusiasm and a clear understanding of the responsibilities outlined in the job description.
Showcase Your Technical Skills:Be specific about your hands-on experience with tools like PySpark and SQL. We’re looking for solid examples of how you’ve built and maintained data pipelines, so don’t hold back on the details!
Apply Through Our Website:We encourage you to apply directly through our website. It’s the best way for us to receive your application and ensures you’re considered for this exciting opportunity in Sheffield!
How to prepare for a job interview at Essential Consulting
✨Know Your Tech Stack
Make sure you brush up on your knowledge of Hadoop, Cloudera, PySpark, and Python. Be ready to discuss specific projects where you've used these technologies, as well as any challenges you faced and how you overcame them.
✨Showcase Your Problem-Solving Skills
Prepare to talk about complex data challenges you've tackled in the past. Use the STAR method (Situation, Task, Action, Result) to structure your answers and highlight your analytical thinking and technical prowess.
✨Understand the Business Context
Since this role is within a banking organisation, it’s crucial to understand how data engineering supports business and regulatory functions. Familiarise yourself with the financial services sector and be ready to discuss how your work can impact the organisation's goals.
✨Ask Insightful Questions
Prepare thoughtful questions about the team, the data transformation programme, and the technologies they use. This shows your genuine interest in the role and helps you assess if it's the right fit for you.
