Data Engineer

Data Engineer

Sheffield Full-Time 36000 - 60000 £ / year (est.) Home office (partial)
I

At a Glance

  • Tasks: Lead backend infrastructure for our B2B lead intelligence platform and manage data pipelines.
  • Company: Join Instantly.ai, a top AI-driven sales outreach platform powering 35K+ B2B companies.
  • Benefits: Enjoy a fast-paced startup environment with autonomy and impactful work.
  • Why this job: Be part of a high-growth team where your contributions directly influence success.
  • Qualifications: Experience in AWS, Elasticsearch, Python, and data engineering is essential.
  • Other info: Collaborate with talented developers and enjoy a dynamic, innovative culture.

The predicted salary is between 36000 - 60000 £ per year.

Instantly.ai is a leading AI-driven sales outreach and lead intelligence platform, powering over 35K B2B companies.

We’re hiring a Data Engineer to lead the backend infrastructure of SuperSearch, our B2B lead intelligence platform. You will own and maintain large-scale data pipelines using AWS Glue (PySpark), S3, Elasticsearch, and MongoDB. This role is central to improving how users search, filter, and find leads, applying everything from algorithm tuning to semantic enhancements with LLMs and embeddings. You’ll have full ownership of a critical system in a fast-moving and high-growth startup environment.

Responsibilities

  • Own and maintain our data processing pipelines using AWS Glue (PySpark) and S3
  • Work with large-scale datasets stored in Elasticsearch and MongoDB
  • Build robust data transformation, cleaning, and normalization workflows
  • Improve the performance and relevance of our search system through algorithmic tuning and semantic enhancements (e.g. LLMs, DeepL, embeddings)

Must-Have Skills

  • Solid experience with data engineering on AWS (Glue, S3)
  • Strong knowledge of Elasticsearch (query design, aggregations, performance tuning...)
  • Proficiency in Python, especially in data wrangling (PySpark, Pandas)
  • Experience with data quality, schema evolution, and operational monitoring
  • Familiarity with LLMs, embeddings, or search ranking improvements is a plus
  • Backend development skills with Node.js or general JavaScript knowledge would be advantageous

Why Instantly.ai?

  • High-growth environment: join us on the path to unicorn status.
  • Impact & autonomy: you’ll own a marquee area critical to our success. No slow processes of big enterprise companies. We move fast like a young lean startup.
  • Collaborative culture: work with top developers and seasoned operators.

Apply now and we will be in touch shortly.

Data Engineer employer: Instantly.ai

Instantly.ai is an exceptional employer, offering a dynamic and high-growth environment where you can make a significant impact as a Data Engineer. With a collaborative culture that fosters innovation and autonomy, you'll have the opportunity to lead critical projects and work alongside top talent in the industry. Join us to be part of a fast-paced startup that values your contributions and supports your professional growth.
I

Contact Detail:

Instantly.ai Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Data Engineer

✨Tip Number 1

Familiarise yourself with AWS Glue and S3 by working on personal projects or contributing to open-source initiatives. This hands-on experience will not only boost your confidence but also demonstrate your practical skills during interviews.

✨Tip Number 2

Dive deep into Elasticsearch by creating sample queries and aggregations. Understanding how to optimise performance and relevance in search systems will give you a significant edge when discussing your capabilities with us.

✨Tip Number 3

Brush up on your Python skills, particularly in data wrangling with PySpark and Pandas. Being able to showcase your ability to handle large datasets effectively will be crucial in demonstrating your fit for the role.

✨Tip Number 4

Stay updated on the latest trends in LLMs and embeddings. Having a solid understanding of these concepts will not only impress us but also show your commitment to improving search systems and algorithms.

We think you need these skills to ace Data Engineer

AWS Glue
PySpark
S3
Elasticsearch
MongoDB
Data Pipeline Management
Data Transformation
Data Cleaning
Data Normalisation
Algorithm Tuning
Semantic Enhancements
Python
Pandas
Data Quality Assurance
Schema Evolution
Operational Monitoring
Node.js
JavaScript

Some tips for your application 🫡

Understand the Role: Read the job description carefully to understand the specific skills and responsibilities required for the Data Engineer position at Instantly.ai. Tailor your application to highlight your relevant experience with AWS, Elasticsearch, and Python.

Highlight Relevant Experience: In your CV and cover letter, emphasise your solid experience with data engineering on AWS, particularly with Glue and S3. Mention any projects where you've worked with large-scale datasets or improved search systems using algorithm tuning.

Showcase Technical Skills: Make sure to detail your proficiency in Python, especially in data wrangling with PySpark and Pandas. If you have experience with LLMs or embeddings, include that as well, as it aligns with the role's requirements.

Craft a Compelling Cover Letter: Write a cover letter that not only outlines your qualifications but also expresses your enthusiasm for working in a high-growth startup environment like Instantly.ai. Discuss how you can contribute to their mission and culture.

How to prepare for a job interview at Instantly.ai

✨Showcase Your Technical Skills

Be prepared to discuss your experience with AWS Glue, S3, and Elasticsearch in detail. Highlight specific projects where you've successfully built or maintained data pipelines, and be ready to explain the challenges you faced and how you overcame them.

✨Demonstrate Problem-Solving Abilities

Expect questions that assess your problem-solving skills, especially related to data transformation and cleaning. Prepare examples of how you've improved data quality or performance in previous roles, focusing on algorithm tuning and semantic enhancements.

✨Familiarise Yourself with LLMs and Embeddings

Since familiarity with LLMs and embeddings is a plus, brush up on these concepts before the interview. Be ready to discuss how they can enhance search relevance and performance, and think of ways you could apply them in the role.

✨Emphasise Collaboration and Autonomy

Instantly.ai values a collaborative culture and autonomy. Share experiences where you've worked effectively in teams, as well as instances where you've taken ownership of projects. This will demonstrate that you're a good fit for their fast-paced environment.

Data Engineer
Instantly.ai
I
  • Data Engineer

    Sheffield
    Full-Time
    36000 - 60000 £ / year (est.)

    Application deadline: 2027-06-27

  • I

    Instantly.ai

Similar positions in other companies
UK’s top job board for Gen Z
discover-jobs-cta
Discover now
>