Scraping Tech Lead – Web scraping, Anti-bot
Infatica.io
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇲🇳 Mongolia
Visit company websiteJob Level
Senior
Tech Stack
GoKubernetesPrometheusPythonRedis
About the role
- Lead the web scraping development team and manage architectural decisions
- Design high-parallel crawler, session management, anti-bot bypass, CAPTCHA solver
- Develop API, authorization, billing, quotas, monitoring
- Participate in hiring and team building for backend, browser, DevOps, and QA engineers
- Set development and release processes, ensure code quality control
- Conduct anti-bot research and protection bypass strategies
- Set up CI/CD, monitoring, and scaling configurations
Requirements
- 5+ years of engineering experience in high-load backend/data platforms
- Extensive Scraping experience (mandatory)
- Excellent understanding of **HTTP, TLS, HTTP/2, proxies, browser stack (CDP, WebRTC)**
- Experience with async** Python** and **Go** (ideally both), **Redis, queues, message brokers**
- Advanced level DevOps tools: **Kubernetes, Helm, Prometheus, CI/CD**
- Experience analyzing and bypassing bot protection systems — strong plus
- **Fluent English** (all documentation and part of the team are English-speaking)
- Decision-making skills, mentoring abilities, and accountability for results
Benefits
- Participate in developing the company's key product from scratch
- High autonomy and influence on architecture and team decisions
- Budget for conferences, courses, and work tools
- Competitive compensation package
- Remote work flexibility
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
web scrapingAPI developmentsession managementanti-bot bypassCAPTCHA solverasync PythonGoRedisKubernetesCI/CD
Soft skills
decision-makingmentoringaccountability