Scraping Tech Lead – Web scraping, Anti-bot
Infatica.io
full-time
Posted on:
Location Type: Remote
Location: Remote • 🇦🇿 Azerbaijan
Visit company websiteJob Level
Senior
Tech Stack
GoKubernetesPrometheusPythonRedis
About the role
- Lead the web scraping development team and drive architectural decisions
- Oversee design of data-plane and control-plane infrastructure
- Participate in hiring backend, browser, DevOps, and QA engineers
- Establish development and release processes and code quality control
- Conduct anti-bot research and develop protection bypass mechanisms
- Set up CI/CD, scaling configuration, and monitoring organization
Requirements
- 5+ years of engineering experience in high-load backend/data platforms
- Extensive Scraping experience (mandatory)
- Excellent understanding of HTTP, TLS, HTTP/2, proxies, browser stack (CDP, WebRTC)
- Experience with async Python and Go (ideally both), Redis, queues, message brokers
- Advanced level DevOps tools: Kubernetes, Helm, Prometheus, CI/CD
- Experience analyzing and bypassing bot protection systems — strong plus
- Fluent English (all documentation and part of the team are English-speaking)
- Decision-making skills, mentoring abilities, and accountability for results
Benefits
- Participate in developing the company's key product from scratch
- High autonomy and influence on architecture and team decisions
- Budget for conferences, courses, and work tools
- Competitive compensation package
- Remote work flexibility
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
web scrapingbackend engineeringdata platformsasync PythonGoRedisKubernetesHelmPrometheusCI/CD
Soft skills
decision-makingmentoringaccountability