Data Pipeline Engineer in London

Data Pipeline Engineer in London

London Full-Time 40000 - 60000 £ / year (est.) No working from home possible
H

At a Glance

  • Tasks: Ensure data accuracy by responding to pipeline failures and modifying code.
  • Company: Hexegic is a top technical consultancy offering dynamic projects for career growth.
  • Benefits: Enjoy a competitive salary, professional development budget, wellness programme, and hybrid work options.
  • Other info: Candidates must have UK nationality and residency for security clearance.
  • Why this job: Join a vibrant team and work on exciting projects that enhance your skills and impact.
  • Qualifications: Proficiency in Python, PySpark, and Java; basic Spark knowledge required.

The predicted salary is between 40000 - 60000 £ per year.

You will ensure our customer works with updated and correct data in our data analytics tools by being the first to respond to data health failures on key pipelines, reading code and making changes.

About us

Hexegic are a leading technical consultancy providing agile multi-disciplinary teams to high performing organisations. The company promises exciting, engaging and rewarding projects for those that are keen to develop and build a successful career.

Core Responsibilities

  • Maintain build schedules so that pipelines run effectively
  • Set up and maintain health checks on data pipelines
  • Respond, triage and debug the pipelines when broken
  • Read and make changes to code, and modify monitoring set-ups
  • Communicating outages to end users

What we are looking for

  • Comfortable reading and writing code in Python, PySpark
  • Basic understanding of Sparkli>
  • Ability to navigate pipeline development tools

What’s in it for you?

  • Base salary of £50,000-£60,000
  • £5000 a year professional development budget
  • Wellness program
  • 25 days annual leave
  • Hybrid working arrangements

Please note that successful candidates must be eligible for UK security clearance

#J-18808-Ljbffr

Data Pipeline Engineer in London employer: Hexegic

Hexegic is an exceptional employer that prioritises the professional growth and well-being of its employees, offering a generous £5,000 annual development budget and a comprehensive wellness programme including private healthcare. With a collaborative work culture in London, employees are encouraged to contribute to innovative projects in a secure environment, ensuring both personal and professional fulfilment while working alongside a talented team dedicated to making a meaningful impact.

H

Contact Details:

Hexegic Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Data Pipeline Engineer in London

Tip Number 1

Familiarise yourself with the specific data pipeline tools and technologies mentioned in the job description. Having hands-on experience or projects that showcase your skills in Python, PySpark, and Java will make you stand out.

Tip Number 2

Engage with the data engineering community online. Join forums, attend webinars, or participate in relevant discussions to not only learn but also network with professionals who might provide insights or referrals for the role.

Tip Number 3

Prepare to discuss real-world scenarios where you've successfully debugged data pipelines or improved their efficiency. Being able to share specific examples will demonstrate your problem-solving skills and technical expertise.

Tip Number 4

Research Hexegic and understand their projects and values. Tailoring your conversation during interviews to align with their mission can show your genuine interest in the company and the role.

We think you need these skills to ace Data Pipeline Engineer in London

Proficiency in Python
Experience with PySpark
Knowledge of Java
Understanding of Spark architecture
Data pipeline development
Debugging skills
Code modification and maintenance

Some tips for your application 🫡

Understand the Role:Before applying, make sure you fully understand the responsibilities of a Data Pipeline Engineer. Familiarise yourself with the key skills required, such as coding in Python, PySpark, and Java, as well as knowledge of Spark and pipeline development tools.

Tailor Your CV:Customise your CV to highlight relevant experience and skills that align with the job description. Emphasise your coding abilities, experience with data pipelines, and any previous roles that involved debugging or maintaining data systems.

Craft a Compelling Cover Letter:Write a cover letter that showcases your passion for data engineering and your understanding of Hexegic's mission. Mention specific projects or experiences that demonstrate your ability to respond to data health failures and communicate effectively with end users.

Proofread Your Application:Before submitting, carefully proofread your application materials. Check for any spelling or grammatical errors, and ensure that all information is clear and concise. A polished application reflects your attention to detail, which is crucial for this role.

How to prepare for a job interview at Hexegic

Brush Up on Your Coding Skills

Since the role requires reading and writing code in Python, PySpark, and Java, make sure you're comfortable with these languages. Review common coding challenges and be prepared to demonstrate your coding skills during the interview.

Understand Data Pipelines

Familiarise yourself with data pipeline concepts and tools. Be ready to discuss how you would maintain build schedules and set up health checks, as well as how to respond to and debug pipeline failures.

Prepare for Scenario-Based Questions

Expect questions that assess your problem-solving abilities. Think of scenarios where you've had to triage or debug a broken pipeline and be ready to explain your thought process and actions taken.

Communicate Clearly

Effective communication is key, especially when informing end users about outages. Practice articulating technical issues in a way that non-technical stakeholders can understand, as this will likely come up in the interview.