At a Glance
- Tasks: Lead backend infrastructure for our B2B lead intelligence platform and manage data pipelines.
- Company: Instantly.ai is a top AI-driven sales outreach platform serving over 35K B2B companies.
- Benefits: Enjoy a fast-paced startup environment with autonomy and impactful work.
- Why this job: Join a high-growth team, own critical systems, and collaborate with top talent.
- Qualifications: Experience in AWS data engineering, Elasticsearch, and Python required; familiarity with LLMs is a plus.
- Other info: Be part of a dynamic culture aiming for unicorn status.
The predicted salary is between 36000 - 60000 £ per year.
Instantly.ai is a leading AI-driven sales outreach and lead intelligence platform, powering over 35K B2B companies.
We’re hiring a Data Engineer to lead the backend infrastructure of SuperSearch, our B2B lead intelligence platform. You will own and maintain large-scale data pipelines using AWS Glue (PySpark), S3, Elasticsearch, and MongoDB. This role is central to improving how users search, filter, and find leads, applying everything from algorithm tuning to semantic enhancements with LLMs and embeddings. You’ll have full ownership of a critical system in a fast-moving and high-growth startup environment.
Responsibilities
- Own and maintain our data processing pipelines using AWS Glue (PySpark) and S3
- Work with large-scale datasets stored in Elasticsearch and MongoDB
- Build robust data transformation, cleaning, and normalization workflows
- Improve the performance and relevance of our search system through algorithmic tuning and semantic enhancements (e.g. LLMs, DeepL, embeddings)
Must-Have Skills
- Solid experience with data engineering on AWS (Glue, S3)
- Strong knowledge of Elasticsearch (query design, aggregations, performance tuning...)
- Proficiency in Python, especially in data wrangling (PySpark, Pandas)
- Experience with data quality, schema evolution, and operational monitoring
- Familiarity with LLMs, embeddings, or search ranking improvements is a plus
- Backend development skills with Node.js or general JavaScript knowledge would be advantageous
Why Instantly.ai?
- High-growth environment: join us on the path to unicorn status.
- Impact & autonomy: you’ll own a marquee area critical to our success. No slow processes of big enterprise companies. We move fast like a young lean startup.
- Collaborative culture: work with top developers and seasoned operators.
Apply now and we will be in touch shortly.
Data Engineer employer: Instantly.ai
Contact Detail:
Instantly.ai Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Data Engineer
✨Tip Number 1
Familiarise yourself with AWS Glue and S3, as these are crucial for the role. Consider building a small project that utilises these tools to demonstrate your hands-on experience.
✨Tip Number 2
Brush up on your Elasticsearch skills, particularly in query design and performance tuning. You could even contribute to open-source projects or forums to showcase your expertise.
✨Tip Number 3
Since the role involves algorithm tuning and semantic enhancements, explore recent advancements in LLMs and embeddings. Being able to discuss these topics in detail will set you apart during interviews.
✨Tip Number 4
Network with current data engineers or professionals in similar roles. Engaging in discussions about their experiences can provide valuable insights and potentially lead to referrals.
We think you need these skills to ace Data Engineer
Some tips for your application 🫡
Understand the Role: Before applying, make sure you fully understand the responsibilities and requirements of the Data Engineer position at Instantly.ai. Familiarise yourself with the technologies mentioned, such as AWS Glue, Elasticsearch, and Python.
Tailor Your CV: Customise your CV to highlight relevant experience in data engineering, particularly with AWS services and data processing. Emphasise any projects or roles where you've worked with large datasets or improved search systems.
Craft a Compelling Cover Letter: Write a cover letter that showcases your passion for data engineering and your understanding of Instantly.ai's mission. Mention specific skills that align with the job description, such as your experience with algorithm tuning or LLMs.
Proofread Your Application: Before submitting, carefully proofread your application materials. Check for any spelling or grammatical errors, and ensure that all information is clear and concise. A polished application reflects your attention to detail.
How to prepare for a job interview at Instantly.ai
✨Showcase Your Technical Skills
Be prepared to discuss your experience with AWS Glue, S3, and Elasticsearch in detail. Highlight specific projects where you've used these technologies, focusing on the challenges you faced and how you overcame them.
✨Demonstrate Problem-Solving Abilities
Expect questions that assess your problem-solving skills, especially related to data pipelines and algorithm tuning. Prepare examples of how you've improved data processing or search relevance in past roles.
✨Familiarise Yourself with LLMs and Embeddings
Since familiarity with LLMs and embeddings is a plus, brush up on these concepts. Be ready to discuss how they can enhance search systems and provide examples of their application in real-world scenarios.
✨Ask Insightful Questions
Prepare thoughtful questions about the company's data infrastructure and future projects. This shows your genuine interest in the role and helps you understand how you can contribute to their success.