At a Glance
- Tasks: Design and develop scalable data pipelines using Hadoop, PySpark, and Python.
- Company: Join a major global banking organisation with a focus on data technology.
- Benefits: Competitive daily rate, hybrid work model, and potential for contract extension.
- Other info: Dynamic environment with opportunities for professional growth in the financial sector.
- Why this job: Work on enterprise-grade data platforms and tackle complex data challenges.
- Qualifications: Strong experience in Data Engineering and proficiency in Hadoop and Python.
Location: Sheffield (Hybrid 3 days per week preferred)
c.£600 per day Inside IR35
Initial 6-month contract with strong likelihood of extension
We are supporting a major global banking organisation on the growth of its Data Technology function and are looking for an experienced Data Engineer to join a large-scale data transformation programme. This is an excellent opportunity to work on enterprise-grade data platforms, building and enhancing data pipelines that support critical business and regulatory functions across a complex global environment.
Please note this role is aligned to the bank's Sheffield office, therefore there is a preference for individuals who would be able to travel to this location, if they are not already based in the local area.
Key Responsibilities- Design, develop and maintain scalable data pipelines and ETL processes
- Develop robust solutions using Python, PySpark and SQL
- Work with large-scale datasets in distributed data environments
- Develop and support data solutions within on-prem Hadoop / Cloudera environments
- Support data ingestion, transformation and processing across Hadoop Data Lake platforms
- Contribute to data modelling and data warehousing initiatives
- Support CI/CD and automation practices across the data engineering lifecycle
- Collaborate with business stakeholders, architects and engineering teams to deliver high-quality data solutions
- Ensure data quality, performance and reliability across data platforms
- Strong commercial experience in Data Engineering
- Strong hands-on experience with Hadoop / Cloudera CDH on an on-premises platform
- Experience with Hadoop ecosystem technologies such as HDFS, Hive, Impala, Sqoop, YARN and/or MapReduce
- Excellent Python and PySpark development skills
- Advanced SQL knowledge
- Experience building and maintaining data pipelines and ETL solutions
- Good understanding of data warehousing and data modelling concepts
- Experience working within large-scale enterprise environments
- CI/CD experience
- Jenkins
- Ansible
- SAS
- Experience working with distributed systems and cloud-based data platforms
- Financial services or banking sector experience
The successful candidate will be a hands-on Data Engineer who enjoys solving complex data challenges and can quickly contribute within a fast-paced, delivery-focused environment.
Locations
Data Engineer Hadoop / Cloudera / PySpark / Python in Sheffield, Yorkshire employer: Essential Consulting
Join a leading global banking organisation in Sheffield, where you will be part of a dynamic team driving significant data transformation initiatives. With a strong focus on employee growth and development, the company offers a collaborative work culture that values innovation and excellence, alongside competitive compensation and flexible hybrid working arrangements. This role not only provides the opportunity to work with cutting-edge technologies but also to contribute to critical business functions in a supportive environment that prioritises your professional advancement.
StudySmarter Expert Advice🤫
We think this is how you could land Data Engineer Hadoop / Cloudera / PySpark / Python in Sheffield, Yorkshire
✨Network Like a Pro
Get out there and connect with folks in the industry! Attend meetups, webinars, or even local tech events. You never know who might have the inside scoop on job openings or can put in a good word for you.
✨Show Off Your Skills
Don’t just talk about your experience; demonstrate it! Create a portfolio showcasing your data pipelines, ETL processes, or any projects using Python and PySpark. This will give potential employers a taste of what you can do.
✨Ace the Interview
Prepare for technical interviews by brushing up on your Hadoop, Cloudera, and SQL skills. Practice common data engineering problems and be ready to discuss your past projects in detail. Confidence is key!
✨Apply Through Us
Make sure to apply through our website! We’re always on the lookout for talented Data Engineers like you. Plus, it’s a great way to get noticed by our hiring team directly.
We think you need these skills to ace Data Engineer Hadoop / Cloudera / PySpark / Python in Sheffield, Yorkshire
Some tips for your application 🫡
Tailor Your CV:Make sure your CV highlights your experience with Hadoop, Cloudera, and Python. We want to see how your skills match the job description, so don’t be shy about showcasing your relevant projects and achievements!
Craft a Compelling Cover Letter:Your cover letter is your chance to shine! Use it to explain why you’re the perfect fit for this Data Engineer role. Share your passion for data engineering and how your experience aligns with our needs at StudySmarter.
Showcase Your Technical Skills:We’re looking for strong hands-on experience, so make sure to mention your proficiency in PySpark, SQL, and any other relevant technologies. Include specific examples of how you've used these skills in past roles to solve complex data challenges.
Apply Through Our Website:Don’t forget to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. Plus, we love seeing candidates who take that extra step to connect with us directly.
How to prepare for a job interview at Essential Consulting
✨Know Your Tech Inside Out
Make sure you brush up on your knowledge of Hadoop, Cloudera, PySpark, and Python. Be ready to discuss your hands-on experience with these technologies, as well as any specific projects you've worked on that showcase your skills in building data pipelines and ETL processes.
✨Showcase Your Problem-Solving Skills
Prepare to share examples of complex data challenges you've faced and how you tackled them. This role is all about solving problems, so demonstrating your analytical thinking and ability to deliver solutions will impress the interviewers.
✨Understand the Business Context
Familiarise yourself with the banking sector and the importance of data in regulatory functions. Being able to connect your technical skills to business outcomes will show that you understand the bigger picture and can contribute effectively to the team.
✨Ask Insightful Questions
Prepare a few thoughtful questions about the company's data transformation programme and their expectations for the role. This not only shows your interest but also helps you gauge if the company culture and project align with your career goals.
