Data Ingestion Engineer in London

Data Ingestion Engineer in London

London Full-Time 63000 - 77000 £ / year (est.) Hybrid
F

At a Glance

  • Tasks: Build and run data pipelines for AI and robotics in the automotive industry.
  • Company: Leading AI and robotics business transforming the automotive space.
  • Benefits: Competitive pay, flexible working, and opportunities for professional growth.
  • Other info: Work in a dynamic environment with exciting projects and career advancement.
  • Why this job: Join a cutting-edge team and shape the future of machine learning.
  • Qualifications: Experience in data engineering, Python, PySpark, and SQL required.

The predicted salary is between 63000 - 77000 £ per year.

Our client, a leading AI and robotics business in the automotive space, is looking for a Senior Data Ingestion Engineer who has built data platforms that teach machines to see and move. We're looking for a Data Ingestion Engineer to build and run the pipelines that bring large, complex datasets into our data platform. You'll work with gigabyte- to terabyte-scale data from many sources and turn it into clean, reliable, well-modelled datasets for analytics, data science and machine learning teams. The role suits an engineer who understands data domains as well as code. You'll know where data comes from, what it means and how it should be shaped for the people who use it.

Key Responsibilities

  • Design, build and maintain batch and streaming ingestion pipelines using Python, PySpark and SQL
  • Ingest structured, semi-structured and sensor or time-series data from files, APIs, databases and device feeds
  • Process and transform datasets from gigabytes to multiple terabytes efficiently and cost-effectively
  • Understand the business and technical meaning of each data domain, and model data so it is usable downstream
  • Build data quality checks, validation, schema management and monitoring into every pipeline
  • Tune Spark jobs for performance, partitioning and storage layout at scale
  • Work with data scientists, ML engineers and analysts to understand their needs and deliver the right datasets
  • Document pipelines, data lineage and data dictionaries
  • Support production pipelines, troubleshoot failures and improve reliability

Essential Skills and Experience

  • Proven commercial experience as a Data Engineer or Data Ingestion Engineer
  • Strong Python programming for data processing and pipeline development
  • Hands-on PySpark experience with large distributed datasets
  • Advanced SQL, including complex queries, performance tuning and data modelling
  • Track record of working with large-scale data, from gigabytes up to multiple terabytes
  • Good understanding of data domains: how data is produced, what it represents and how it should be structured
  • Experience with data quality, validation and schema evolution
  • Familiarity with a cloud data platform such as AWS, Azure, GCP or Databricks
  • Version control (Git) and CI/CD for data pipelines

Desirable Experience

  • Automotive sector experience, such as vehicle, connected-car, telematics or autonomous driving data
  • Working knowledge of IMU (inertial measurement unit) data or other high-frequency sensor and time-series data
  • Exposure to computer vision or robotics datasets, such as camera, lidar or sensor-fusion data
  • Financial services experience, particularly with large, regulated or high-volume datasets
  • Streaming technologies such as Kafka or Spark Structured Streaming
  • Lakehouse formats and tooling such as Delta Lake, Apache Iceberg or Parquet
  • Orchestration tools such as Airflow or Dagster

This is an Inside IR35 Contract Role working via umbrella company so you must be resident in the UK to be considered, and be prepared to be onsite 2-3 days per week in London Kings Cross.

Data Ingestion Engineer in London employer: Focus Cloud

Join a forward-thinking company that values innovation and collaboration, offering a dynamic work culture in the West Midlands. As an SAP S/4HANA EWM Consultant, you'll benefit from extensive professional development opportunities while working alongside industry experts to enhance your skills. Enjoy a supportive environment that prioritises employee well-being and fosters continuous improvement in logistics processes.

F

Contact Details:

Focus Cloud Recruitment Team

StudySmarter Expert Advice🤫

We think this is how you could land Data Ingestion Engineer in London

✨Get Involved in Data Science Meetups

Tap into local data science meetups or workshops to connect with fellow enthusiasts and professionals. These events are goldmines for networking, and sometimes even lead directly to job openings at companies like Focus Cloud!

✨Show Off Your Projects

Start building a public portfolio showcasing your data science projects on platforms like GitHub or personal websites. Highlight unique analyses or models you've developed. This not only demonstrates your skills but also gets your name out there for roles like Data Ingestion Engineer at Focus Cloud.

✨Leverage Professional Networks

Join professional bodies related to data science, like the Data Science Society or similar organisations. Getting involved can lead to mentorship opportunities and insider knowledge about full-time positions at companies like Focus Cloud.

✨Apply Directly through Our Website

When you find a suitable opening like Data Ingestion Engineer at Focus Cloud, make sure to apply directly through our website. It gives you an edge and shows you're keen to join our team. Plus, who doesn’t love a direct application? It’s easier than navigating through job boards!

We think you need these skills to ace Data Ingestion Engineer in London

Python
Data Engineering
Communication Skills
Problem-Solving Skills
SQL
ETL/ELT Processes
Data Pipeline Development

Some tips for your application 🫡

Show Off Your Projects:In the world of data science, your projects can speak volumes about your skills. Make sure to showcase a few key projects in your CV or portfolio, especially those that highlight your ability to work with data sets, build models, or use relevant tools like Python, R, or SQL. Don’t forget to include links to any GitHub repositories if applicable!

Quantify Your Achievements:Employers love numbers! When drafting your CV, highlight your achievements with quantifiable results. For instance, mention how your data analysis led to a certain percentage increase in efficiency or revenue at a previous job or project. These details can really make your application pop!

Craft a Tailored Cover Letter:For a full-time role at Focus Cloud, your cover letter should reflect your passion for data science and your excitement about the specific projects or values of the company. Dive into why you’re a good fit, how your skills align with their needs, and any unique perspectives you can bring to the team.

Stand Out with Relevant Courses and Certifications:Although experience talks, relevant courses or certifications can be your ticket to impressing hiring managers at Focus Cloud. Mention any standout courses you've completed that equipped you with essential skills, such as machine learning certifications or data visualisation courses. This shows your commitment to continuously developing your skills in the field!

How to prepare for a job interview at Focus Cloud

✨Brush Up on Your Statistics

For a data science role, we need to seriously sharpen our statistics skills. Get ready to tackle technical questions on probability distributions, hypothesis testing, and regression analysis. These are often the bread and butter of data science interviews, so don't just skim over them!

✨Showcase Your Projects

Prepare a killer portfolio showcasing your data science projects. We should include details about the datasets used, the tools and techniques applied, and the impact of your findings. If we can walk them through a particularly challenging project or a cool visualisation that had real-world implications, it’ll really make us stand out!

✨Get Comfortable with Python and R

Most data science positions require us to be proficient in programming languages like Python and R. We should practice common libraries like pandas, NumPy, and scikit-learn, and be ready for live coding exercises or algorithm questions. Showing off our coding chops can really impress the interviewers at Focus Cloud!

✨Prepare for Case Studies

Expect to encounter real-world case studies during the interview. We might be asked how we’d approach a data problem or analyse a dataset to extract insights. It's essential to think out loud and demonstrate our problem-solving process so that the interviewer can see our logical thinking in action.