Web Scraping Specialist

MLabs

Web Scraping Specialist joining a technical team focused on web data extraction for AI. Leading initiatives for optimizing scraping processes and data accessibility.

Posted 6/26/2026full-timeRemote • New York • 🇺🇸 United StatesMid-LevelSenior💰 $75,000 - $100,000 per yearWebsite

Tech Stack

Tools & technologies

AWSAzureCassandraCloudJavaScriptMongoDBNoSQLPythonSelenium

About the role

Key responsibilities & impact

Code Development: Write, test, and refine high-performance code to extract data from various online sources, ensuring maximum reliability and efficiency.
Data Retrieval: Manage complex data retrieval tasks, including handling pagination and dynamic content loaded via AJAX.
Data Quality: Clean and format extracted data to ensure it meets rigorous quality standards for downstream analysis and processing.
Database Management: Store and manage scraped data in appropriate databases, optimizing for both access speed and long-term data integrity.
Monitoring and Maintenance: Regularly monitor scraping processes and infrastructure to identify and resolve issues, ensuring a continuous and stable data flow.

Requirements

What you’ll need

Extraction Expertise: Demonstrated ability to extract data from complex websites with minimal supervision, supported by a portfolio of past projects.
Technical Proficiency: Advanced skills in Python or JavaScript, specifically with libraries and frameworks such as BeautifulSoup, Scrapy, or Selenium.
Advanced Programming: Strong knowledge of asynchronous programming, multithreading, and distributed scraping architectures.
Web Fundamentals: In-depth knowledge of HTML, CSS, JavaScript, and the Document Object Model (DOM).
Data Storage: Experience with NoSQL databases (e.g., MongoDB, Cassandra), including the ability to design efficient storage solutions.
Cloud Infrastructure: Experience deploying and managing large-scale scraping jobs using cloud services such as AWS, Google Cloud, or Azure.
Preferred Skills: Ability to apply machine learning algorithms for data cleaning, categorization, or predictive analysis; active participation in relevant open-source projects.

Benefits

Comp & perks

Competitive Compensation: A highly competitive salary ranging from **$75,000 to $100,000**, complemented by a comprehensive benefits and equity package.
Impactful Work: The opportunity to work at the forefront of AI development and web-scale knowledge graph creation.
High-Output Culture: A professional environment that prioritizes low ego, technical autonomy, and rapid execution.
Remote Flexibility: This is a remote position requiring a 6-hour overlap with the core team's schedule.

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

PythonJavaScriptBeautifulSoupScrapySeleniumasynchronous programmingmultithreadingdistributed scraping architecturesHTMLCSS

Soft Skills

data extraction expertiseproblem-solvingattention to detailindependenceproject management