
Web Scraping Engineer, Python
Oxylabs.io
full-time
Posted on:
Location Type: Remote
Location: Poland
Visit company websiteExplore more
Salary
💰 PLN 20,000 per month
About the role
- Develop scalable scrapers.
- Define resilient scraping strategies, unblock websites for scraping.
- Improve observability in the system.
- Develop back-end solutions for scraping & parsing problems of various magnitudes.
- Maintain the current system and develop new features related to scraping & parsing.
Requirements
- Experience working with Python.
- Understanding of computer science, including data structures, algorithms, computability and complexity.
- Version Control skills using Git.
- Knowledge on how to unblock websites for scraping.
- Is able to use different scraping techniques & open-source tools to build scrapers.
- Is comfortable with using Dev Tools.
- Network (TLS/SSL) knowledge.
- Worked with browser automations.
- Knows their way around asynchronous programming.
- Nice to have:
- Web development knowledge.
- Knows how to use CSS Selectors / XPaths for parsing.
- Experience working with Go & C++.
- Worked on browser source code.
- Knowledge of any front-end framework.
- Experience working with Pydantic, FastAPI, SQLAlchemy.
- Has experience working with Redis, MySQL, Docker, Kubernetes, Elasticsearch, Kibana and monitoring tools like Grafana, Prometheus.
- Experience with machine learning that is scraping domain-specific.
- Has experience in building scalable systems.
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
Pythondata structuresalgorithmsversion controlscraping techniquesasynchronous programmingCSS SelectorsXPathsmachine learningscalable systems