Find a job 
Featured Companies 
Featured Universities 
For Companies At a Glance
- Tasks: Design and build large-scale web scraping systems using Python.
- Company: Join Adthena, an award-winning search intelligence platform with a vibrant culture.
- Benefits: Enjoy remote work, flexible hours, stock options, and trust-based vacation.
- Why this job: Make a real impact in a leading tech company while honing your skills.
- Qualifications: Strong Python experience and knowledge of web scraping techniques required.
- Other info: Collaborative environment with excellent career growth and regular social events.
The predicted salary is between 48000 - 84000 ÂŁ per year.
Our Mission
Join us in shaping the future of paid search intelligence. Adthena is an award-winning search intelligence platform powered by patented AI technology and a team of dedicated experts. We help brands, marketers, and agencies dominate their competitive landscapes with unparalleled insights into the paid search market. Our Whole Market View, Smart Monitor, and Local View solutions give clients the clarity to optimize spend, increase ROI, and stay ahead of the competition. Trusted by global brands like Citibank, LâOrĂ©al, and Volvo, and backed by Updata Partners, weâve been redefining search intelligence since 2012.
In 2025, Adthena continued its winning streak, earning 8 major search industry awards. Highlights include Best AI Search Software Solution at the US Search Awards, Best Search Software Tool at the European Search Awards, and Best Software Innovation at the Global Search Awards. Ready to make an impact in an industry-leading company? Letâs do it together.
Why Join Us?
We offer the best of both worlds: the maturity and stability of a well-established company combined with the energy, agility, and impact of a scaling tech organisation. If youâve been hesitant about joining a typical tech company due to concerns about chaos, fragility, or volatility, Adthena is your answer. Weâre smaller than large-scale enterprises, offering more autonomy, less red tape, and accelerated growth.
Hereâs what we offer:
- Startup Engineering culture
- Strong Culture: Our quarterly surveys show a 93% average approval rating for company culture, with an overall eNPS of 27.
- Award-Winning Product: US 2025 Search Awards for Best AI Search Software Innovation
- Stock Options: Our employees do incredible work, so as we grow, everyone shares the rewards.
- Trust-Based Vacation: Take as much time off as you need, when you need it.
- Remote-First: 52% of Adthenianâs work fully remote, with others choosing Hybrid Work at our 3 Geohubs (London, Austin, Sydney).
- Flexible Work: Work how and where you do your best, with full autonomy over your day.
- Career Growth: Bespoke training and career development via "Sherpa plansâ to guide your growth.
- Monthly Hackdays & Training Days
- Family Care Package: Up to 6 months fully paid maternity leave, and 2 months paternity leave.
- Home Office Stipend: $200 for your ideal remote setup.
- Swag Welcome Gift: $70 credit to grab some merch.
- Birthday Day Off: Celebrate your special day.
- Regular Socials: Summer & Christmas parties, annual and quarterly offsites, monthly meet-ups.
- Volunteer Days: Make a difference with paid volunteer time each quarter.
About the Role
Reporting to: Paul Felby, Chief Product & Tech Officer
Location: UK Remote
Interviews: 3 Stages
Start Date: ASAP
What youâll do at Adthena
As a Senior Python Scraping Engineer, you will design, build, and operate large-scale, resilient web scraping systems, with a strong focus on Google and Google-like search environments. This role sits at the intersection of data engineering, reverse engineering, and systems reliability, and is critical to delivering accurate, timely, and trustworthy data at scale. You will work on complex scraping problems where naĂŻve approaches do not work, including dynamic rendering, anti-bot defences, frequent markup changes, and high-volume data collection. We are leaders in adopting coding with AI tools. The role is ideal for someone who believes in agentic coding and would like to improve their skills.
Responsibilities
- Design and maintain large-scale Python scraping systems that operate reliably against Google and other highly defended websites
- Build scrapers for dynamic, JavaScript-heavy pages using browser automation and hybrid approaches
- Continuously adapt to changes in page structure, request flows, and anti-automation mechanisms
- Engineer robust extraction pipelines that prioritise data accuracy, consistency, and observability
- Implement proxy, fingerprinting, and request-routing strategies to maximise stability and throughput
- Monitor scrape health, detect failures early, and rapidly debug production issues
- Optimise performance, cost, and latency across scraping infrastructure
- Work closely with data engineers, data scientists, and product teams to ensure scraped data is usable and trusted
- Document scraping logic and operational runbooks for long-term maintainability
Who we look for
Research shows men apply if they meet ~60% of the criteria, while women and underrepresented groups apply only if they meet all requirements. If you have the skills but don't meet every requirement, reach out â weâd love to explore how you could be a great fit!
Required Experience:
- Strong professional experience with Python, including production-grade scraping systems
- Deep hands-on experience scraping Google or similarly protected platforms
- Solid understanding of HTTP, TLS, cookies, headers, redirects, and browser networking behaviour
- Experience with tools such as Playwright, Selenium, Puppeteer, or equivalent browser automation frameworks
- Strong knowledge of HTML parsing, DOM traversal, and data extraction techniques
- Experience handling rate limiting, CAPTCHA, IP rotation, and bot detection systems
- Comfortable working with asynchronous and concurrent scraping architectures
- Experience running scrapers at scale in cloud environments
- Strong debugging skills and ability to reason about complex failure modes
- Experience with headless browser fingerprinting and anti-bot evasion techniques
Nice To Have:
- Familiarity with containerisation and orchestration, such as Docker and Kubernetes
- Experience with distributed task systems and job queues
- Background in data quality monitoring and anomaly detection
- Experience working with search, advertising, or competitive intelligence data
What We Value
- Pragmatic problem-solving in hostile and fast-changing technical environments
- High ownership of systems that run continuously and at scale
- A strong bias toward reliability, correctness, and observability
- Ability to explain complex technical behaviour clearly to non-specialists
- Curiosity about how large platforms evolve their defences and infrastructure
Our Core Values
All Adthenians are expected to align closely with our âCore Valuesâ. What it means...
- Get Shit Done: We're big on taking action, owning our challenges, and finding solutions.
- Freedom with Responsibility: We take charge of results to recognition. We know that our hustle not only moves the needle for the company but also sets us up for personal success.
- Deliver Remarkable Quality: We care about exceeding expectations in the work we do and aim to always do our best work as individuals and as a team.
- Smart & Always Improving: We strive daily to expand our knowledge and become better at what we do.
Senior Python Scraping Engineer in London employer: Adthena
Contact Detail:
Adthena Recruiting Team
StudySmarter Expert Advice đ€«
We think this is how you could land Senior Python Scraping Engineer in London
âšTip Number 1
Network like a pro! Reach out to folks in the industry, attend meetups, and connect with potential colleagues on LinkedIn. You never know who might have the inside scoop on job openings or can put in a good word for you.
âšTip Number 2
Show off your skills! Create a portfolio showcasing your Python scraping projects. Whether it's a GitHub repo or a personal website, having tangible examples of your work can really set you apart from the crowd.
âšTip Number 3
Prepare for those interviews! Research common technical questions related to web scraping and be ready to discuss your problem-solving approach. Practising coding challenges can also help you feel more confident when itâs time to shine.
âšTip Number 4
Apply through our website! We love seeing applications directly from candidates who are excited about joining us at Adthena. It shows initiative and gives you a better chance of standing out in the hiring process.
We think you need these skills to ace Senior Python Scraping Engineer in London
Some tips for your application đ«Ą
Tailor Your CV: Make sure your CV is tailored to the Senior Python Scraping Engineer role. Highlight your experience with Python and web scraping, especially any work you've done with Google or similar platforms. We want to see how your skills align with what we're looking for!
Craft a Compelling Cover Letter: Your cover letter is your chance to shine! Use it to tell us why you're passionate about web scraping and how you can contribute to our mission at Adthena. Be sure to mention any relevant projects or achievements that showcase your expertise.
Showcase Your Problem-Solving Skills: In your application, don't just list your skillsâshow us how you've used them to solve complex problems in the past. We love candidates who can think critically and adapt to challenges, so share specific examples of your successes!
Apply Through Our Website: We encourage you to apply directly through our website. Itâs the best way to ensure your application gets into the right hands. Plus, you'll find all the details you need about the role and our company culture there!
How to prepare for a job interview at Adthena
âšKnow Your Python Inside Out
As a Senior Python Scraping Engineer, youâll need to showcase your expertise in Python. Brush up on your knowledge of production-grade scraping systems and be ready to discuss your experience with tools like Playwright or Selenium. Prepare to explain how you've tackled complex scraping challenges in the past.
âšDemonstrate Problem-Solving Skills
Adthena values pragmatic problem-solving, especially in fast-changing environments. Be prepared to share specific examples of how you've approached difficult scraping problems, such as dealing with anti-bot defences or dynamic content. Highlight your ability to adapt and find solutions under pressure.
âšFamiliarise Yourself with Their Core Values
Understanding Adthena's core values is crucial. They prioritise getting things done, taking responsibility, and delivering quality. Think about how your personal work ethic aligns with these values and be ready to discuss instances where you've embodied them in your previous roles.
âšAsk Insightful Questions
Interviews are a two-way street! Prepare thoughtful questions that show your interest in the role and the company. Inquire about their approach to handling scraping challenges or how they foster a culture of continuous improvement. This not only demonstrates your enthusiasm but also helps you gauge if Adthena is the right fit for you.
