Apply

Ready to go for it?

AI Apply speeds things up—apply directly if you prefer.

FREE ACCESS
5,000–10,000 jobs/day
JobTailor Logo

See all jobs on JobTailor

Search thousands of fresh jobs every day.

Discover
  • Fresh listings
  • Fast filters
  • No subscription required
Create a free account and start exploring right away.
Two Six Technologies

Data Collection Engineer

Two Six Technologies

Data Collection Engineer designing and maintaining distributed web scraping infrastructure for Two Six Technologies. Building resilient data pipelines to harvest data from complex web ecosystems.

Posted 7/10/2026full-timeRemote • 🇺🇸 United StatesSeniorLead💰 $160,000 - $200,000 per yearWebsite

Tech Stack

Tools & technologies
ElasticSearchKubernetesPython

About the role

Key responsibilities & impact
  • Design and deploy high-performance, distributed web scrapers using Python and Scrapy
  • Utilize Browser Scripting tools to navigate, interact with, and extract data from websites
  • Deploy, scale, and manage scraping workloads on Kubernetes
  • Define strict JSON Schemas and leverage Pydantic for data validation
  • Build and optimize search and storage pipelines using Elasticsearch
  • Architect robust pipeline workflows to manage the end-to-end data lifecycle
  • Manage complex proxy rotation and session handling to maintain high success rates

Requirements

What you’ll need
  • 7+ years of professional software engineering experience
  • Excellent reverse-engineering skills
  • Expert-level proficiency in Python
  • Deep experience with Scrapy
  • Proven experience with browser automation tools
  • Mastery of JSON and data validation using Pydantic
  • Hands-on experience indexing, querying, and optimizing Elasticsearch clusters
  • Strong proficiency in managing and scaling applications within Kubernetes environments
  • Experience building structured pipeline workflows
  • Bachelor’s degree in Computer Science or Engineering

Benefits

Comp & perks
  • medical, dental, and vision insurance
  • life and disability insurance
  • retirement benefits
  • paid leave
  • tuition assistance
  • professional development

ATS Keywords

✓ Tailor your resume
Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools
Web ScrapingBrowser AutomationJSON Schema DefinitionData Pipeline DevelopmentProxy Rotation ManagementSession HandlingReverse EngineeringData IndexingData QueryingData Optimization
Soft Skills
Problem SolvingAnalytical Thinking
Certifications
Bachelor’s Degree in Computer ScienceBachelor’s Degree in Engineering