At a Glance
- Tasks: Design and maintain large-scale web scrapers while tackling advanced anti-bot systems.
- Company: Join a growing AI-focused data team in a fully remote role.
- Benefits: Competitive salary, flexible work environment, and opportunities for professional growth.
- Why this job: Make an impact by ensuring high-quality, trusted data for innovative AI projects.
- Qualifications: Strong Python scraping experience and knowledge of anti-bot techniques required.
- Other info: Collaborate with talented teams in a dynamic, supportive environment.
The predicted salary is between 48000 - 84000 Β£ per year.
Location: Fully remote
Salary: Β£60,000 - Β£70,000
The Opportunity
I'm looking for a Python Scraping Engineer to join a growing AI-focused data team.
What You'll Do
- Design, build, and maintain large-scale production web scrapers
- Tackle advanced anti-bot and detection systems
- Work with browser automation and dynamic, JavaScript-heavy sites
- Improve scraper reliability, throughput, and data quality
- Collaborate closely with data engineers and AI teams to ensure scraped data is trusted and usable
What We're Looking For
- Strong Python-based scraping experience (production, large-scale)
- Deep knowledge of:
- Anti-bot detection & evasion
- Browser fingerprinting
- CAPTCHA solving
- Proxy and IP management
- HTTP protocols and browser networking
Tech Preferences
- Python (preferred)
Interview Process
- CTO interview
- Meet the team
Senior Python Scraping Engineer in City of London employer: Harnham - Data & Analytics Recruitment
Contact Detail:
Harnham - Data & Analytics Recruitment Recruiting Team
StudySmarter Expert Advice π€«
We think this is how you could land Senior Python Scraping Engineer in City of London
β¨Tip Number 1
Network like a pro! Reach out to folks in the industry on LinkedIn or join relevant online communities. You never know who might have a lead on that perfect Senior Python Scraping Engineer role.
β¨Tip Number 2
Show off your skills! Create a portfolio showcasing your web scraping projects. This is your chance to demonstrate your expertise in tackling anti-bot systems and browser automation tools.
β¨Tip Number 3
Prepare for those interviews! Brush up on your knowledge of HTTP protocols, proxy management, and debugging techniques. We want you to shine when discussing your experience with large-scale production scrapers.
β¨Tip Number 4
Apply through our website! Itβs the best way to ensure your application gets seen by the right people. Plus, we love seeing candidates who take the initiative to connect directly with us.
We think you need these skills to ace Senior Python Scraping Engineer in City of London
Some tips for your application π«‘
Tailor Your CV: Make sure your CV highlights your Python scraping experience and any relevant projects you've worked on. We want to see how your skills align with what we're looking for, so donβt be shy about showcasing your achievements!
Craft a Compelling Cover Letter: Your cover letter is your chance to tell us why you're the perfect fit for the role. Share your passion for web scraping and AI, and mention specific tools or techniques youβve mastered that relate to our needs.
Showcase Your Problem-Solving Skills: In your application, give examples of how you've tackled complex scraping challenges in the past. We love seeing how you approach problems, especially when it comes to anti-bot detection and browser automation.
Apply Through Our Website: We encourage you to apply directly through our website. Itβs the best way for us to receive your application and ensures youβre considered for the role. Plus, it makes the process smoother for everyone involved!
How to prepare for a job interview at Harnham - Data & Analytics Recruitment
β¨Know Your Python Inside Out
Make sure you brush up on your Python skills, especially in relation to web scraping. Be prepared to discuss your past projects and how you've tackled challenges like anti-bot detection and browser automation.
β¨Familiarise Yourself with Tools
Get comfortable with tools like Playwright, Selenium, and Puppeteer. You might be asked to demonstrate your knowledge or even solve a problem on the spot, so having hands-on experience will give you an edge.
β¨Understand the Bigger Picture
Since you'll be collaborating with data engineers and AI teams, itβs crucial to understand how your role fits into the overall data pipeline. Be ready to discuss how you ensure the reliability and quality of the data you scrape.
β¨Prepare for Technical Questions
Expect some technical questions that dive deep into HTTP protocols, proxy management, and debugging complex scraping failures. Practising these topics beforehand will help you feel more confident during the interview.