Senior Software Engineer, Web-Scale Crawling & AI Search in London

Senior Software Engineer, Web-Scale Crawling & AI Search in London

London Full-Time 80000 - 100000 Β£ / year (est.) No working from home possible
Nebius

At a Glance

  • Tasks: Design and develop scalable crawling systems for a cutting-edge AI search engine.
  • Company: Join Nebius, a pioneering tech company revolutionising AI cloud platforms.
  • Benefits: Enjoy competitive pay, flexible work options, and opportunities for professional growth.
  • Other info: Dynamic team environment with exciting challenges and career advancement potential.
  • Why this job: Be at the forefront of AI technology and make a significant impact on data retrieval.
  • Qualifications: Proven experience in software engineering and a passion for innovative tech solutions.

The predicted salary is between 80000 - 100000 Β£ per year.

Nebius is building a full-stack AI cloud platform and a novel search engine.

We seek a Senior Software Engineer to work on the content acquisition and crawling infrastructure, discovering, fetching, and refreshing data from the open web at scale.

You will design distributed crawling, scheduling, and ingestion systems for billions of URLs, balancing coverage, freshness, and cost while collaborating with indexing and ML teams to meet retrieval and ranking requirements.

#J-18808-Ljbffr

Senior Software Engineer, Web-Scale Crawling & AI Search in London employer: Nebius

Nebius is an exceptional employer that fosters a dynamic and innovative work culture, particularly for those in the Remote Field CTO role. With flexible working options in London or remotely, employees benefit from a supportive environment that encourages professional growth and collaboration, while also having the unique opportunity to shape cutting-edge cloud services in the retail sector.

Nebius

Contact Details:

Nebius Recruitment Team

We think you need these skills to ace Senior Software Engineer, Web-Scale Crawling & AI Search in London

Distributed Systems Design
Crawling Infrastructure Development
Data Ingestion Techniques
URL Scheduling
Scalability Solutions
Collaboration with ML Teams
Indexing Strategies