At a Glance
- Tasks: Lead backend infrastructure for our B2B lead intelligence platform and manage data pipelines.
- Company: Join Instantly.ai, a top AI-driven sales outreach platform powering 35K+ B2B companies.
- Benefits: Enjoy a fast-paced startup environment with autonomy and impactful work.
- Why this job: Be part of a high-growth team where your contributions directly influence success.
- Qualifications: Experience in AWS, Elasticsearch, Python, and data engineering is essential.
- Other info: Collaborate with talented developers and enjoy a dynamic, innovative culture.
The predicted salary is between 36000 - 60000 £ per year.
Instantly.ai is a leading AI-driven sales outreach and lead intelligence platform, powering over 35K B2B companies.
We’re hiring a Data Engineer to lead the backend infrastructure of SuperSearch, our B2B lead intelligence platform. You will own and maintain large-scale data pipelines using AWS Glue (PySpark), S3, Elasticsearch, and MongoDB. This role is central to improving how users search, filter, and find leads, applying everything from algorithm tuning to semantic enhancements with LLMs and embeddings. You’ll have full ownership of a critical system in a fast-moving and high-growth startup environment.
Responsibilities
- Own and maintain our data processing pipelines using AWS Glue (PySpark) and S3
- Work with large-scale datasets stored in Elasticsearch and MongoDB
- Build robust data transformation, cleaning, and normalization workflows
- Improve the performance and relevance of our search system through algorithmic tuning and semantic enhancements (e.g. LLMs, DeepL, embeddings)
Must-Have Skills
- Solid experience with data engineering on AWS (Glue, S3)
- Strong knowledge of Elasticsearch (query design, aggregations, performance tuning...)
- Proficiency in Python, especially in data wrangling (PySpark, Pandas)
- Experience with data quality, schema evolution, and operational monitoring
- Familiarity with LLMs, embeddings, or search ranking improvements is a plus
- Backend development skills with Node.js or general JavaScript knowledge would be advantageous
Why Instantly.ai?
- High-growth environment: join us on the path to unicorn status.
- Impact & autonomy: you’ll own a marquee area critical to our success. No slow processes of big enterprise companies. We move fast like a young lean startup.
- Collaborative culture: work with top developers and seasoned operators.
Apply now and we will be in touch shortly.
Data Engineer employer: Instantly.ai
Contact Detail:
Instantly.ai Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Data Engineer
✨Tip Number 1
Familiarise yourself with AWS Glue and S3 by working on personal projects or contributing to open-source initiatives. This hands-on experience will not only boost your confidence but also demonstrate your practical skills during interviews.
✨Tip Number 2
Dive deep into Elasticsearch by creating sample queries and aggregations. Understanding how to optimise performance and relevance in search systems will give you a significant edge when discussing your capabilities with us.
✨Tip Number 3
Brush up on your Python skills, particularly in data wrangling with PySpark and Pandas. Being able to showcase your ability to handle large datasets effectively will be crucial in demonstrating your fit for the role.
✨Tip Number 4
Stay updated on the latest trends in LLMs and embeddings. Having a solid understanding of these concepts will not only impress us but also show your commitment to improving search systems and algorithms.
We think you need these skills to ace Data Engineer
Some tips for your application 🫡
Understand the Role: Read the job description carefully to understand the specific skills and responsibilities required for the Data Engineer position at Instantly.ai. Tailor your application to highlight your relevant experience with AWS, Elasticsearch, and Python.
Highlight Relevant Experience: In your CV and cover letter, emphasise your solid experience with data engineering on AWS, particularly with Glue and S3. Mention any projects where you've worked with large-scale datasets or improved search systems using algorithm tuning.
Showcase Technical Skills: Make sure to detail your proficiency in Python, especially in data wrangling with PySpark and Pandas. If you have experience with LLMs or embeddings, include that as well, as it aligns with the role's requirements.
Craft a Compelling Cover Letter: Write a cover letter that not only outlines your qualifications but also expresses your enthusiasm for working in a high-growth startup environment like Instantly.ai. Discuss how you can contribute to their mission and culture.
How to prepare for a job interview at Instantly.ai
✨Showcase Your Technical Skills
Be prepared to discuss your experience with AWS Glue, S3, and Elasticsearch in detail. Highlight specific projects where you've successfully built or maintained data pipelines, and be ready to explain the challenges you faced and how you overcame them.
✨Demonstrate Problem-Solving Abilities
Expect questions that assess your problem-solving skills, especially related to data transformation and cleaning. Prepare examples of how you've improved data quality or performance in previous roles, focusing on algorithm tuning and semantic enhancements.
✨Familiarise Yourself with LLMs and Embeddings
Since familiarity with LLMs and embeddings is a plus, brush up on these concepts before the interview. Be ready to discuss how they can enhance search relevance and performance, and think of ways you could apply them in the role.
✨Emphasise Collaboration and Autonomy
Instantly.ai values a collaborative culture and autonomy. Share experiences where you've worked effectively in teams, as well as instances where you've taken ownership of projects. This will demonstrate that you're a good fit for their fast-paced environment.