Architect and own large-scale, Python-based automation systems
Design event-driven, distributed automation pipelines that coordinate scraping, data processing, and downstream actions
Lead the design and evolution of web scraping systems operating in adversarial conditions
Build and refine bot detection avoidance strategies
Own workflow orchestration using Prefect to manage long-running, failure-tolerant workflows
Design systems with strong guarantees around idempotency, retries, partial-state recovery, and backoff
Partner with Product, Security, and Data teams to translate ambiguous requirements
Establish patterns and standards for observability, alerting, and operational hygiene
Mentor senior engineers and influence platform direction through design reviews
Make principled decisions about when automation is inappropriate

Requirements

10+ years of professional software engineering experience
5+ years of hands-on Python as your primary language in production systems
Demonstrated ownership of long-lived automation or platform systems operating at scale
Strong experience with distributed systems and event-driven architectures
Experience operating systems in AWS and/or GCP environments
Demonstrated technical mentorship or platform leadership, regardless of title
U.S. residency required
Advanced proficiency in English to effectively communicate complex information

Benefits

Digital privacy protection for you and your family
Learning and conference opportunities (Black Hat, DEF CON, etc.)

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

Pythonautomation systemsweb scrapingdistributed systemsevent-driven architecturesworkflow orchestrationobservabilityalertingidempotencydata processing

Soft Skills

technical mentorshipplatform leadershipcommunicationdecision makingcollaboration