Explore more
About the role
- Design, develop and maintain Scrapy web crawlers.
- Leverage the Zyte platform and our open source projects to perform distributed information extraction, retrieval and data processing
- Identify and resolve performance and scalability issues with distributed crawling at scale
- Help identify, debug and fix problems with open source projects, including Scrapy
Requirements
- 3+ years of software development experience in Python.
- Solid Python knowledge.
- Familiarity with Linux/UNIX, HTTP, HTML, Javascript and Networking.
- Good communication in written and spoken English
- Availability to work full time.
- Bonus points for:
- Scrapy experience is a big plus.
- Familiarity with techniques and tools for crawling, extracting and processing data (e.g. Scrapy, NLTK, pandas, scikit-learn, mapreduce, nosql, etc).
- Proficient English
Benefits
- Become part of a self-motivated, progressive, multi-cultural team.
- Have the freedom and flexibility to work from where you do your best work.
- Attend conferences and meet with team members from across the globe.
- Work with cutting-edge open source technologies and tools.
- 35 days paid holidays
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
PythonScrapyNLTKpandasscikit-learnmapreducenosqlweb crawlingdata extractiondata processing
Soft Skills
communicationproblem-solving