Spark-Powered Data Ingestion Engineer β€” High-Throughput Pipelines

Spark-Powered Data Ingestion Engineer β€” High-Throughput Pipelines

Full-Time 50000 - 65000 Β£ / year (est.) No working from home possible
Annapurna

At a Glance

  • Tasks: Enhance data ingestion pipelines and optimise Spark jobs for high throughput.
  • Company: Annapurna, a forward-thinking tech company in London.
  • Benefits: Hybrid working environment and flexible freelance contract.
  • Other info: Exciting opportunity to improve high-volume data systems.
  • Why this job: Join a dynamic team and work on real-world driving data projects.
  • Qualifications: Strong experience with Apache Spark and distributed data systems.

The predicted salary is between 50000 - 65000 Β£ per year.

Annapurna is seeking a Data Ingestion Engineer for a 6-month freelance contract in London. The role involves enhancing the reliability and efficiency of data ingestion pipelines, particularly in processing real-world driving data.

Key tasks include:

  • Debugging
  • Investigating data issues
  • Optimising Spark jobs for throughput

The ideal candidate will have strong experience with Apache Spark and distributed data systems. This role offers a hybrid working environment and the opportunity to work on high-volume systems.

Spark-Powered Data Ingestion Engineer β€” High-Throughput Pipelines employer: Annapurna

Annapurna is an excellent employer, offering a dynamic and supportive work culture that fosters innovation and collaboration. With a focus on employee growth, you will have access to professional development opportunities while working in a hybrid environment in London, allowing for a balanced work-life experience. Join us to be part of a team that values your contributions and empowers you to excel in high-throughput data systems.

Annapurna

Contact Details:

Annapurna Recruitment Team

We think you need these skills to ace Spark-Powered Data Ingestion Engineer β€” High-Throughput Pipelines

SQL
Data Pipeline Development
Python
Problem-Solving Skills
Data Engineering
API Integration
Communication Skills