Scraping Tech Lead – Web scraping, Anti-bot
Infatica.io
full-time
Posted on:
Location Type: Remote
Location: Remote • Tajikistan
Visit company websiteJob Level
Senior
Tech Stack
GoKubernetesPrometheusPythonRedis
About the role
- Lead the web scraping development team and drive architectural decisions
- Develop high-parallel crawler, session management, anti-bot bypass, and CAPTCHA solver
- Design API, authorization, billing, quotas, and monitoring
- Participate in hiring backend, browser, DevOps, and QA engineers
- Establish development and release processes and ensure code quality control
- Research and implement anti-bot techniques and protect against various systems
- Set up and manage CI/CD processes, monitoring organization, and SLA processes
Requirements
- 5+ years of engineering experience in high-load backend/data platforms
- Extensive Scraping experience (mandatory)
- Excellent understanding of HTTP, TLS, HTTP/2, proxies, browser stack (CDP, WebRTC)
- Experience with async Python and Go (ideally both), Redis, queues, message brokers
- Advanced level DevOps tools: Kubernetes, Helm, Prometheus, CI/CD
- Experience analyzing and bypassing bot protection systems — strong plus
- Fluent English (all documentation and part of the team are English-speaking)
- Decision-making skills, mentoring abilities, and accountability for results
Benefits
- Participate in developing the company's key product from scratch
- High autonomy and influence on architecture and team decisions
- Budget for conferences, courses, and work tools
- Competitive compensation package
- Remote work flexibility
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
web scrapinghigh-parallel crawlersession managementanti-bot bypassCAPTCHA solverAPI designasync PythonGoRedismessage brokers
Soft skills
decision-makingmentoringaccountability