Backend Software Engineer - Search, Crawler Team (London, Belgrade, Berlin)
Backend Software Engineer - Search, Crawler Team (London, Belgrade, Berlin)

Backend Software Engineer - Search, Crawler Team (London, Belgrade, Berlin)

London Full-Time 36000 - 60000 ÂŁ / year (est.) No home office possible
P

At a Glance

  • Tasks: Design and develop systems for managing web-scale data with cutting-edge technologies.
  • Company: Join Perplexity, a forward-thinking tech company with a collaborative culture.
  • Benefits: Enjoy comprehensive health insurance, 401(k) plan, and potential equity options.
  • Why this job: Make a real impact by working on innovative projects in advanced search technologies.
  • Qualifications: 5+ years of software development experience, especially with Python, C++, Rust, or Go.
  • Other info: Dynamic environment with opportunities for career growth and learning.

The predicted salary is between 36000 - 60000 ÂŁ per year.

We are seeking an experienced Backend Software Engineer to join our Crawler team. In this role, you will design, develop, and operate systems that ingest, process, and manage web‑scale data in support of our next‑generation advanced search technologies. This is a critical, high‑impact engineering position, requiring expertise across both backend and frontend components of our data acquisition stack.

Responsibilities

  • Take ownership of and lead projects focused on developing large‑scale web crawlers, ingestion pipelines, and data processing systems.
  • Build, maintain, and optimize core backend and frontend components for crawler services, including storage, retrieval, and UI dashboards for data management.
  • Collaborate closely with Search and Infrastructure teams to ensure reliable, high‑quality ingestion and processing of billions of web pages.
  • Architect and implement full‑stack features and scalable distributed systems that handle high‑load and real‑time data operations.
  • Rapidly iterate, experiment with novel approaches, and continuously enhance system performance, usability, and reliability.

Qualifications

  • Minimum of 5 years of software development experience, with strong knowledge of data structures and algorithms in at least one of the following languages: Python, C++, Rust, or Go.
  • Experience with large‑scale web crawlers is highly desirable.
  • Proven experience building, deploying, and optimizing high‑load, distributed, and hardware‑adjacent services.
  • Deep understanding of cloud infrastructure, with hands‑on experience in Kubernetes (K8s) and AWS.
  • Demonstrated passion for writing clean, efficient, and scalable systems.

Final offer amounts are determined by multiple factors, including experience and expertise.

Equity: In addition to the base salary, equity may be part of the total compensation package.

Benefits: Comprehensive health, dental, and vision insurance for you and your dependents. Includes a 401(k) plan.

Seniority level: Mid‑Senior level

Employment type: Full‑time

Job function: Engineering and Information Technology

Industries: Software Development

Backend Software Engineer - Search, Crawler Team (London, Belgrade, Berlin) employer: Perplexity

Perplexity is an exceptional employer that fosters a dynamic and innovative work culture, particularly for Backend Software Engineers in our Crawler team. Located in vibrant cities like London, Belgrade, and Berlin, we offer comprehensive health benefits, a 401(k) plan, and equity options, ensuring our employees are well-supported both personally and professionally. With a strong emphasis on collaboration and continuous learning, we provide ample opportunities for growth and the chance to work on cutting-edge technologies that shape the future of search.
P

Contact Detail:

Perplexity Recruiting Team

StudySmarter Expert Advice 🤫

We think this is how you could land Backend Software Engineer - Search, Crawler Team (London, Belgrade, Berlin)

✨Tip Number 1

Network like a pro! Reach out to folks in the industry, attend meetups, and connect with people on LinkedIn. You never know who might have the inside scoop on job openings or can refer you directly.

✨Tip Number 2

Show off your skills! Create a portfolio showcasing your projects, especially those related to web crawlers or data processing. This gives potential employers a taste of what you can do and sets you apart from the crowd.

✨Tip Number 3

Prepare for technical interviews by brushing up on your algorithms and data structures. Practice coding challenges on platforms like LeetCode or HackerRank to get comfortable with problem-solving under pressure.

✨Tip Number 4

Apply through our website! It’s the best way to ensure your application gets seen. Plus, it shows you’re genuinely interested in joining our team at Perplexity. Don’t miss out!

We think you need these skills to ace Backend Software Engineer - Search, Crawler Team (London, Belgrade, Berlin)

Backend Software Development
Web Crawlers
Data Processing Systems
Python
C++
Rust
Go
Distributed Systems
Cloud Infrastructure
Kubernetes (K8s)
AWS
Data Structures
Algorithms
System Performance Optimization
Clean Code Practices

Some tips for your application 🫡

Tailor Your CV: Make sure your CV is tailored to the Backend Software Engineer role. Highlight your experience with web crawlers, data processing systems, and any relevant programming languages like Python or Go. We want to see how your skills match what we're looking for!

Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to explain why you're passionate about this role and how your background makes you a great fit. Don’t forget to mention any specific projects that relate to our Crawler team’s work.

Showcase Your Projects: If you've worked on any large-scale web crawlers or distributed systems, make sure to showcase them in your application. We love seeing real examples of your work, so include links or descriptions of your projects that demonstrate your expertise.

Apply Through Our Website: We encourage you to apply through our website for the best chance of getting noticed. It helps us keep track of applications and ensures you’re considered for the role. Plus, it’s super easy to do!

How to prepare for a job interview at Perplexity

✨Know Your Tech Stack

Make sure you’re well-versed in the languages and technologies mentioned in the job description, like Python, C++, Rust, or Go. Brush up on your knowledge of data structures and algorithms, as these are likely to come up during technical questions.

✨Showcase Your Experience with Crawlers

If you have experience with large-scale web crawlers, be ready to discuss specific projects you've worked on. Highlight your role in developing, deploying, and optimising these systems, as this will demonstrate your fit for the position.

✨Prepare for System Design Questions

Expect to tackle system design questions that assess your ability to architect scalable distributed systems. Think about how you would approach building a web crawler or ingestion pipeline, and be prepared to explain your thought process clearly.

✨Collaborate and Communicate

Since collaboration is key in this role, practice articulating your ideas and experiences in a way that shows you can work well with others. Be ready to discuss how you’ve collaborated with different teams in the past, especially in high-load environments.

Backend Software Engineer - Search, Crawler Team (London, Belgrade, Berlin)
Perplexity
Location: London

Land your dream job quicker with Premium

You’re marked as a top applicant with our partner companies
Individual CV and cover letter feedback including tailoring to specific job roles
Be among the first applications for new jobs with our AI application
1:1 support and career advice from our career coaches
Go Premium

Money-back if you don't land a job in 6-months

P
  • Backend Software Engineer - Search, Crawler Team (London, Belgrade, Berlin)

    London
    Full-Time
    36000 - 60000 ÂŁ / year (est.)
  • P

    Perplexity

    50-100
Similar positions in other companies
UK’s top job board for Gen Z
discover-jobs-cta
Discover now
>