Staff Software Engineer, Appointment Management
Zocdoc
AWSJavaScriptMicroservicesNode.jsReactScala
Software Engineer III
Wayvia (formerly PriceSpider)
full-time
Posted on:
Location: 🇺🇸 United States
Visit company websiteSalary
💰 $130,000 - $160,000 per year
Job Level
Mid-LevelSenior
Tech Stack
Cloud
About the role
- At Wayvia, we help the world’s top brands stay ahead—using AI, data, and innovation to shape the future of commerce.
- The Data Acquisition team engineers large-scale, highly distributed pipelines that schedule, orchestrate, and execute tens of millions of data collection tasks daily.
- Work includes high-throughput web crawling, adaptive extraction, intelligent batching, fault-tolerant processing, and distribution of mission-critical datasets.
- Role focuses on building resilient, scalable systems, solving data engineering puzzles, and pushing automation and efficiency in large-scale information retrieval.
- This is a remote position open to candidates based in the United States.
Requirements
- Design and implement advanced capabilities to detect and counter anti-bot protection methods.
- Engineer complex network requests that accurately mimic real user behavior and environments.
- Develop network services leveraging HTTP(S) protocol versions 1.1, 2, and 3.
- Implement and manage egress proxy networks with MITM traffic interception and routing optimization.
- Extend Chrome DevTools Protocol (CDP) with custom commands to support specialized use cases.
- Build and maintain scalable WebSocket infrastructures optimized for short-lived, high-volume connections.
- Design distributed caching systems to support high throughput containerized worker pools.
- Deploy and manage geographically distributed proxies with automated failover and load balancing.
- Optimize compute, storage, and traffic costs for high-volume cloud-based services.
- Proficiency with data parsing, transformation, and storage technologies.
- Unwavering focus on delivering measurable value to customers
