Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Design and operate high-volume web scraping systems, primarily targeting Google.
- Company: Leading tech firm specialising in AI-assisted coding practices.
- Benefits: Fully remote role with a competitive salary of £70k.
- Other info: Collaborative environment with opportunities for professional growth.
- Why this job: Join a dynamic team and tackle complex challenges in data engineering.
- Qualifications: Expert-level Python skills and experience scraping Google at scale required.
The predicted salary is between 70000 - 70000 £ per year.
Please note - to be eligible for this role you must be UK-based with the unrestricted right to work in the UK. This organisation does not offer sponsorship.
My client is hiring a Senior Python Scraping Engineer to design, build, and operate high-volume, highly resilient web scraping systems, with a specific and sustained focus on scraping Google at scale. This is a specialist role. It is not suited to generalist data engineers who have only worked on light or opportunistic scraping. You will be working in hostile, rapidly changing environments where naïve techniques fail and deep expertise in bot detection and evasion is essential.
The role sits at the intersection of data engineering, reverse engineering, and large-scale systems reliability, and plays a critical role in delivering accurate, timely, and trusted data. My client is a leader in adopting AI-assisted and agentic coding practices, and this role is ideal for engineers who actively use AI tools to improve productivity, reasoning, and system design.
Key Responsibilities:
- Design and operate large-scale scraping systems handling 10+ million requests per day, primarily targeting Google and Google-like platforms
- Build robust scrapers for dynamic, JavaScript-heavy environments using browser automation and hybrid approaches
- Continuously adapt to changes in markup, request flows, ranking logic, and anti-automation mechanisms
- Engineer extraction pipelines with a strong emphasis on correctness, consistency, and observability
- Implement and maintain advanced anti-bot evasion strategies, including:
- Proxy and request routing strategies
- Browser and headless fingerprinting
- CAPTCHA handling and mitigation
Required Technical skills:
- Expert-level web scraping skills using Python
- Direct, hands-on experience scraping Google at scale - this is essential
- Deep understanding of:
- Anti-bot and bot-detection systems
- Browser and network fingerprinting
- CAPTCHA systems and mitigation techniques
- Scaling scraping infrastructure reliably
To apply for this role please submit your CV or contact David Airey.
Python Web Scraping Engineer - Fully Remote - £70k in London employer: Tenth Revolution Group
Contact Detail:
Tenth Revolution Group Recruiting Team
StudySmarter Expert Advice 🤫
We think this is how you could land Python Web Scraping Engineer - Fully Remote - £70k in London
✨Tip Number 1
Network like a pro! Reach out to folks in the industry, join relevant online communities, and attend meetups. You never know who might have the inside scoop on job openings or can refer you directly.
✨Tip Number 2
Show off your skills! Create a portfolio showcasing your web scraping projects, especially those using Python. This will give potential employers a taste of what you can do and set you apart from the crowd.
✨Tip Number 3
Prepare for interviews by brushing up on your technical knowledge. Be ready to discuss your experience with anti-bot strategies and scaling scraping systems. Practice common interview questions related to web scraping to boost your confidence.
✨Tip Number 4
Don’t forget to apply through our website! We’ve got loads of opportunities that might be perfect for you. Plus, it’s a great way to ensure your application gets seen by the right people.
We think you need these skills to ace Python Web Scraping Engineer - Fully Remote - £70k in London
Some tips for your application 🫡
Tailor Your CV: Make sure your CV is tailored to the role of Python Web Scraping Engineer. Highlight your experience with web scraping, especially any work you've done with Google or similar platforms. We want to see how your skills match up with what we're looking for!
Showcase Your Technical Skills: Don’t hold back on showcasing your technical skills! Mention your expertise in Python, anti-bot strategies, and any tools like Playwright or Selenium that you’ve used. We love seeing candidates who can demonstrate their hands-on experience.
Be Clear and Concise: When writing your application, keep it clear and concise. Use straightforward language to explain your past experiences and how they relate to the job. We appreciate clarity and want to understand your journey without sifting through fluff.
Apply Through Our Website: Finally, make sure to apply through our website! It’s the best way for us to receive your application and ensures you’re considered for the role. We can’t wait to see what you bring to the table!
How to prepare for a job interview at Tenth Revolution Group
✨Know Your Stuff
Make sure you brush up on your Python web scraping skills, especially when it comes to scraping Google at scale. Be ready to discuss your hands-on experience with tools like Playwright or Selenium, and how you've tackled anti-bot detection in the past.
✨Showcase Your Problem-Solving Skills
Prepare to share specific examples of complex production issues you've debugged. Highlight your thought process and the strategies you used to overcome challenges, especially in hostile environments where naive techniques fail.
✨Communicate Clearly
Strong communication is key! Practice explaining complex technical concepts in a simple way. You might be asked to describe your approach to building robust scrapers or handling CAPTCHA systems, so clarity is crucial.
✨Be Ready for Technical Questions
Expect deep technical questions about scaling scraping infrastructure and managing large volumes of requests. Brush up on your knowledge of TLS, cookies, and browser networking behaviour, as these topics are likely to come up during the interview.