Nebius is seeking a Senior Software Engineer to build the content acquisition and crawling infrastructure for a novel agent-native search platform. You will design and operate distributed crawling systems, ingestion workflows, and scheduling to process billions of URLs at internet scale, balancing coverage, freshness, efficiency and cost.
You will collaborate with indexing and ML teams to ensure acquired content meets retrieval and ranking requirements, while enabling safe experimentation with
#J-18808-Ljbffr
Senior Backend Engineer - Web-Scale Crawling & Ingestion employer: Nebius
At Nebius, we pride ourselves on being at the forefront of cloud computing and AI, offering our employees a unique opportunity to work alongside industry leaders in a dynamic and collaborative environment. With a competitive salary, comprehensive benefits, and flexible working arrangements, we foster professional growth and innovation, making our London office an exciting place for Business Development Consultants to thrive and contribute to transformative projects.
