Data Engineer ( Hadoop / Spark / Scala / Python) in London

Data Engineer ( Hadoop / Spark / Scala / Python) in London

London Full-Time 54000 - 66000 £ / year (est.) Hybrid
Capgemini

At a Glance

  • Tasks: Design and develop Hadoop applications and data pipelines while optimising ETL processes.
  • Company: Join Capgemini, a leader in financial services with a commitment to inclusivity.
  • Benefits: Flexible work locations, competitive salary, and opportunities for professional growth.
  • Other info: Capgemini is a Disability Confident Employer, promoting inclusive recruitment.
  • Why this job: Make an impact by working with cutting-edge technologies in a dynamic environment.
  • Qualifications: Expertise in Spark, Scala, Python, and experience in large-scale data engineering.

The predicted salary is between 54000 - 66000 £ per year.

We are seeking a highly experienced Data Engineer to join our Financial Services Data Practice. You will have deep hands-on expertise in Hadoop, Spark, Scala, and Python. The places that you work from day to day will vary according to your role, your needs, and those of the business; it will be a blend of Company offices, client sites, and your home.

Your Role

  • Design and develop Hadoop based applications and data pipelines
  • Build, operate, monitor and troubleshoot Hadoop clusters
  • Write scalable ETL processes using tools like Hive, Pig, and Spark
  • Develop and maintain data ingestion processes using Sqoop, Flume, or Kafka
  • Optimize MapReduce jobs and manage HDFS storage
  • Collaborate with data scientists and analysts to support data needs
  • Ensure data security and compliance with organizational policies
  • Create and maintain technical documentation and playbooks
  • Evaluate and integrate cloud based big data solutions (AWS, GCP, Azure)

Your Skills

  • Data/software engineering experience with deep expertise in Spark, Scala, and Python.
  • Strong background in designing large-scale ETL/ELT workflows and distributed compute optimization.

We are a Disability Confident Employer. Capgemini is proud to be a Disability Confident Employer (Level 2) under the UK Government’s Disability Confident scheme. As part of our commitment to inclusive recruitment, we will offer an interview to all candidates who:

  • Declare they have a disability, and
  • Meet the minimum essential criteria for the role.

Data Engineer ( Hadoop / Spark / Scala / Python) in London employer: Capgemini

Capgemini is an excellent employer, offering a dynamic work culture that fosters collaboration and innovation in the heart of London. With a hybrid working model, employees enjoy the flexibility of blending office, client site, and home working, while also benefiting from extensive growth opportunities and professional development within the Capital Markets sector. Join us to be part of a team that values governance excellence and empowers you to make a meaningful impact in complex programme environments.

Capgemini

Contact Details:

Capgemini Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Data Engineer ( Hadoop / Spark / Scala / Python) in London

✨Get Involved in Data Science Meetups

Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like Capgemini!

✨Show Off Your Projects

Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Data Engineer ( Hadoop / Spark / Scala / Python) at Capgemini.

✨Leverage Professional Networks

Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like Capgemini.

✨Apply Directly through Our Website

When you find a suitable opening like Data Engineer ( Hadoop / Spark / Scala / Python) at Capgemini, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!

We think you need these skills to ace Data Engineer ( Hadoop / Spark / Scala / Python) in London

Hadoop
Spark
Scala
Python
ETL Processes
Hive
Pig

Some tips for your application 🫡

Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!

Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!

Craft a Tailored Cover Letter:For a full-time role at Capgemini, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.

Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at Capgemini. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!

How to prepare for a job interview at Capgemini

✨Brush Up on Your Statistics

For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!

✨Showcase Your Projects

Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!

✨Get Comfortable with Python and R

Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at Capgemini!

✨Prepare for Case Studies

Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.