At a Glance
- Tasks: Build and run data pipelines for AI and robotics in the automotive industry.
- Company: Leading AI and robotics business transforming the automotive space.
- Benefits: Competitive pay, flexible working, and opportunities for professional growth.
- Other info: Work in a dynamic environment with a focus on innovation and collaboration.
- Why this job: Join a cutting-edge team and shape the future of machine learning and data science.
- Qualifications: Experience in Python, PySpark, SQL, and large-scale data processing.
The predicted salary is between 63000 - 77000 £ per year.
Our client, a leading AI and robotics business in the automotive space, is looking for a Senior Data Ingestion Engineer who has built data platforms that teach machines to see and move. We're looking for a Data Ingestion Engineer to build and run the pipelines that bring large, complex datasets into our data platform. You'll work with gigabyte- to terabyte-scale data from many sources and turn it into clean, reliable, well-modelled datasets for analytics, data science and machine learning teams. The role suits an engineer who understands data domains as well as code. You'll know where data comes from, what it means and how it should be shaped for the people who use it.
Key Responsibilities
- Design, build and maintain batch and streaming ingestion pipelines using Python, PySpark and SQL
- Ingest structured, semi-structured and sensor or time-series data from files, APIs, databases and device feeds
- Process and transform datasets from gigabytes to multiple terabytes efficiently and cost-effectively
- Understand the business and technical meaning of each data domain, and model data so it is usable downstream
- Build data quality checks, validation, schema management and monitoring into every pipeline
- Tune Spark jobs for performance, partitioning and storage layout at scale
- Work with data scientists, ML engineers and analysts to understand their needs and deliver the right datasets
- Document pipelines, data lineage and data dictionaries
- Support production pipelines, troubleshoot failures and improve reliability
Essential Skills and Experience
- Proven commercial experience as a Data Engineer or Data Ingestion Engineer
- Strong Python programming for data processing and pipeline development
- Hands-on PySpark experience with large distributed datasets
- Advanced SQL, including complex queries, performance tuning and data modelling
- Track record of working with large-scale data, from gigabytes up to multiple terabytes
- Good understanding of data domains: how data is produced, what it represents and how it should be structured
- Experience with data quality, validation and schema evolution
- Familiarity with a cloud data platform such as AWS, Azure, GCP or Databricks
- Version control (Git) and CI/CD for data pipelines
Desirable Experience
- Automotive sector experience, such as vehicle, connected-car, telematics or autonomous driving data
- Working knowledge of IMU (inertial measurement unit) data or other high-frequency sensor and time-series data
- Exposure to computer vision or robotics datasets, such as camera, lidar or sensor-fusion data
- Financial services experience, particularly with large, regulated or high-volume datasets
- Streaming technologies such as Kafka or Spark Structured Streaming
- Lakehouse formats and tooling such as Delta Lake, Apache Iceberg or Parquet
- Orchestration tools such as Airflow or Dagster
This is an Inside IR35 Contract Role working via umbrella company so you must be resident in the UK to be considered, and be prepared to be onsite 2-3 days per week in London Kings Cross.
Data Ingestion Engineer employer: Focus Cloud
Join a forward-thinking company that values innovation and collaboration, offering a dynamic work culture in the West Midlands. As an SAP S/4HANA EWM Consultant, you'll benefit from extensive professional development opportunities while working alongside industry experts to enhance your skills. Enjoy a supportive environment that prioritises employee well-being and fosters continuous improvement in logistics processes.
StudySmarter Expert Advice🤫
We think this is how you could land Data Ingestion Engineer
✨Tap into Online Data Science Communities
Join online communities focused on data science like Kaggle, LinkedIn groups, or Reddit threads. These are goldmines for temporary gigs, as you can network with professionals and potentially hear about opportunities at companies like Focus Cloud before they're even advertised!
✨Show Off Your Skills With Projects
Got some cool data science projects? Showcase them on platforms like GitHub or create a personal portfolio website. This visibility is crucial for landing temporary roles—let recruiters see your actual skills in action, which can set you apart from the crowd.
✨Check Out Specialist Job Boards
For temp roles, hit up job boards dedicated to tech and data science, like Stack Overflow Jobs or DataJobs. These platforms often feature openings that you won’t find on general job sites, including contracts with companies like Focus Cloud.
✨Leverage University Resources
If you're currently at uni or recently graduated, tap into your school's career services. They often have connections with companies looking for temporary data science interns or contract workers, and they might even host job fairs with employers like Focus Cloud.
We think you need these skills to ace Data Ingestion Engineer
Some tips for your application 🫡
Highlight Your Data Projects:When applying for a temporary data science role at Focus Cloud, make sure to showcase any relevant projects you've worked on. Whether it's a personal project, an academic undertaking, or contributions to an open-source initiative, detailing these experiences can really set you apart and demonstrate your practical skills.
Emphasise Your Analytical Skills:In your CV and cover letter, focus on the specific analytical skills that are key to data science. Mention any experience with statistical tools, programming languages like Python or R, and data visualisation software. Don't forget to include any certifications that may bolster your expertise!
Show Your Flexibility:Since this is a temporary role, it's important to convey your adaptability and willingness to learn. In your cover letter to Focus Cloud, emphasise how quickly you can get up to speed with new tools or projects. Highlight any previous experiences where you've had to adjust to new environments or challenges.
Craft a Unique Data-Driven Cover Letter:Instead of the usual generic cover letter, spice it up with some data! Maybe you’ve improved a process by 20% in a past role or cleaned a dataset with over a million entries. Use these stats to your advantage to grab Focus Cloud’s attention and show the tangible impact of your work.
How to prepare for a job interview at Focus Cloud
✨Showcase Your Analytical Skills
For a data science gig, it's crucial to demonstrate your analytical abilities. Be ready to discuss previous projects and the methodologies you used. Think about how you can quantify your impact—did your analysis improve efficiency or save costs? These are the stories that will stick with interviewers at Focus Cloud.
✨Brush Up on Technical Skills
You might face technical questions on tools relevant to data science, like Python, R, or SQL. Prepare to solve a problem live—perhaps they'll ask you to write a simple query or code snippet. It’s cool to talk about them, but we need to show we can do it in practice, especially in a temporary role where quick results matter.
✨Highlight Your Adaptability
Since this is a temporary position, emphasise your ability to learn quickly and adapt to new tools or workflows. Share examples of how you've thrived in fast-paced environments before, and how you can hit the ground running at Focus Cloud.
✨Prepare a Portfolio of Your Work
Bring your portfolio to the table—showcase projects where you've leveraged data science techniques to solve problems. Whether it’s a GitHub repository or a set of case studies, having tangible examples of your work will help you stand out and show what you bring to the team at Focus Cloud.