
Python Scraping Engineer
Adthena
full-time
Posted on:
Location Type: Remote
Location: Spain
Visit company websiteExplore more
Tech Stack
About the role
- Design and maintain large-scale Python scraping systems that operate reliably against Google and other highly defended websites
- Build scrapers for dynamic, JavaScript-heavy pages using browser automation and hybrid approaches
- Continuously adapt to changes in page structure, request flows, and anti-automation mechanisms
- Engineer robust extraction pipelines that prioritise data accuracy, consistency, and observability
- Implement proxy, fingerprinting, and request-routing strategies to maximise stability and throughput
- Monitor scrape health, detect failures early, and rapidly debug production issues
- Optimise performance, cost, and latency across scraping infrastructure
- Work closely with data engineers, data scientists, and product teams to ensure scraped data is usable and trusted
- Document scraping logic and operational runbooks for long-term maintainability
Requirements
- Strong professional experience with Python, including production-grade scraping systems
- Deep hands-on experience scraping Google or similarly protected platforms
- Solid understanding of HTTP, TLS, cookies, headers, redirects, and browser networking behaviour
- Experience with tools such as Playwright, Selenium, Puppeteer, or equivalent browser automation frameworks
- Strong knowledge of HTML parsing, DOM traversal, and data extraction techniques
- Experience handling rate limiting, CAPTCHA, IP rotation, and bot detection systems
- Comfortable working with asynchronous and concurrent scraping architectures
- Experience running scrapers at scale in cloud environments
- Strong debugging skills and ability to reason about complex failure modes
- Experience with headless browser fingerprinting and anti-bot evasion techniques
Benefits
- Startup Engineering culture
- Strong Culture: Our quarterly surveys show a 93% average approval rating for company culture, with an overall eNPS of 27.
- Award-Winning Product: US 2025 Search Awards for Best AI Search Software Innovation
- Stock Options: Our employees do incredible work, so as we grow, everyone shares the rewards.
- Trust-Based Vacation: Take as much time off as you need, when you need it.
- Remote-First: 52% of Adthenian’s work fully remote, with others choosing Hybrid Work at our 3 Geohubs (London, Austin, Sydney).
- Flexible Work: Work how and where you do your best, with full autonomy over your day.
- Career Growth: Bespoke training and career development via "Sherpa plans” to guide your growth.
- Monthly Hackdays & Training Days
- Family Care Package: Up to 6 months fully paid maternity leave, and 2 months paternity leave.
- Home Office Stipend: $200 for your ideal remote setup.
- Swag Welcome Gift: $70 credit to grab some merch.
- Birthday Day Off: Celebrate your special day.
- Regular Socials: Summer & Christmas parties, annual and quarterly offsites, monthly meet-ups. See here for more info.
- Volunteer Days: Make a difference with paid volunteer time each quarter. See here for more info.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
Pythonscraping systemsHTTPTLSHTML parsingDOM traversaldata extractionasynchronous architecturesconcurrent architecturesdebugging
Soft skills
problem-solvingcollaborationadaptabilityattention to detailcommunication