At a Glance
- Tasks: Lead backend infrastructure for our B2B lead intelligence platform and manage data pipelines.
- Company: Join Instantly.ai, a top AI-driven sales outreach platform powering 35K+ B2B companies.
- Benefits: Enjoy a fast-paced startup environment with autonomy and impactful work.
- Why this job: Be part of a high-growth team and make a real difference in how users find leads.
- Qualifications: Experience with AWS, Elasticsearch, Python, and data engineering is essential.
- Other info: Collaborate with top developers in a dynamic and supportive culture.
The predicted salary is between 36000 - 60000 £ per year.
Instantly.ai is a leading AI-driven sales outreach and lead intelligence platform, powering over 35K B2B companies.
We’re hiring a Data Engineer to lead the backend infrastructure of SuperSearch, our B2B lead intelligence platform. You will own and maintain large-scale data pipelines using AWS Glue (PySpark), S3, Elasticsearch, and MongoDB. This role is central to improving how users search, filter, and find leads, applying everything from algorithm tuning to semantic enhancements with LLMs and embeddings. You’ll have full ownership of a critical system in a fast-moving and high-growth startup environment.
Responsibilities
- Own and maintain our data processing pipelines using AWS Glue (PySpark) and S3
- Work with large-scale datasets stored in Elasticsearch and MongoDB
- Build robust data transformation, cleaning, and normalization workflows
- Improve the performance and relevance of our search system through algorithmic tuning and semantic enhancements (e.g. LLMs, DeepL, embeddings)
Must-Have Skills
- Solid experience with data engineering on AWS (Glue, S3)
- Strong knowledge of Elasticsearch (query design, aggregations, performance tuning...)
- Proficiency in Python, especially in data wrangling (PySpark, Pandas)
- Experience with data quality, schema evolution, and operational monitoring
- Familiarity with LLMs, embeddings, or search ranking improvements is a plus
- Backend development skills with Node.js or general JavaScript knowledge would be advantageous
Why Instantly.ai?
- High-growth environment: join us on the path to unicorn status.
- Impact & autonomy: you’ll own a marquee area critical to our success. No slow processes of big enterprise companies. We move fast like a young lean startup.
- Collaborative culture: work with top developers and seasoned operators.
Apply now and we will be in touch shortly.
Data Engineer employer: Instantly.ai
Contact Detail:
Instantly.ai Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Data Engineer
✨Tip Number 1
Familiarise yourself with AWS Glue and S3 by working on personal projects or contributing to open-source initiatives. This hands-on experience will not only boost your confidence but also demonstrate your practical skills during discussions.
✨Tip Number 2
Dive deep into Elasticsearch by creating sample queries and aggregations. Understanding how to optimise performance will give you an edge, especially when discussing your approach to improving search systems in the interview.
✨Tip Number 3
Stay updated on the latest trends in data engineering and AI, particularly around LLMs and embeddings. Being able to discuss recent advancements and how they can be applied to enhance search relevance will impress the hiring team.
✨Tip Number 4
Network with current or former employees of Instantly.ai on platforms like LinkedIn. Gaining insights about the company culture and specific challenges they face can help you tailor your approach and show genuine interest during your application process.
We think you need these skills to ace Data Engineer
Some tips for your application 🫡
Understand the Role: Read the job description carefully to understand the specific skills and responsibilities required for the Data Engineer position at Instantly.ai. Tailor your application to highlight your relevant experience with AWS, Elasticsearch, and Python.
Highlight Relevant Experience: In your CV and cover letter, emphasise your solid experience with data engineering on AWS, particularly with Glue and S3. Provide examples of past projects where you have built data pipelines or worked with large-scale datasets.
Showcase Technical Skills: Make sure to detail your proficiency in Python, especially in data wrangling using PySpark and Pandas. If you have experience with LLMs or search ranking improvements, mention these as they are considered a plus for this role.
Craft a Compelling Cover Letter: Write a cover letter that not only outlines your qualifications but also expresses your enthusiasm for working in a high-growth startup environment like Instantly.ai. Mention how you can contribute to their mission and the impact you hope to make.
How to prepare for a job interview at Instantly.ai
✨Showcase Your Technical Skills
Be prepared to discuss your experience with AWS Glue, S3, and Elasticsearch in detail. Highlight specific projects where you've used these technologies, focusing on the challenges you faced and how you overcame them.
✨Demonstrate Problem-Solving Abilities
Expect to be asked about how you would approach data transformation and cleaning tasks. Prepare examples of past situations where you improved data quality or performance, and be ready to explain your thought process.
✨Familiarise Yourself with LLMs and Embeddings
Since familiarity with LLMs and embeddings is a plus, brush up on these concepts. Be ready to discuss how they can enhance search relevance and performance, and think of ways you might apply them in the role.
✨Emphasise Collaboration and Communication
In a fast-moving startup environment, teamwork is crucial. Be prepared to share examples of how you've collaborated with others in previous roles, especially in cross-functional teams, to achieve common goals.