Wayvia (formerly PriceSpider)

Software Engineer III

Wayvia (formerly PriceSpider)

full-time

Posted on:

Origin:  • 🇺🇸 United States

Visit company website
✨ AI Apply
Manual Apply

Salary

💰 $130,000 - $160,000 per year

Job Level

Mid-LevelSenior

Tech Stack

Cloud

About the role

  • At Wayvia, we help the world’s top brands stay ahead—using AI, data, and innovation to shape the future of commerce.
  • The Data Acquisition team engineers large-scale, highly distributed pipelines that schedule, orchestrate, and execute tens of millions of data collection tasks daily.
  • Work includes high-throughput web crawling, adaptive extraction, intelligent batching, fault-tolerant processing, and distribution of mission-critical datasets.
  • Role focuses on building resilient, scalable systems, solving data engineering puzzles, and pushing automation and efficiency in large-scale information retrieval.
  • This is a remote position open to candidates based in the United States.

Requirements

  • Design and implement advanced capabilities to detect and counter anti-bot protection methods.
  • Engineer complex network requests that accurately mimic real user behavior and environments.
  • Develop network services leveraging HTTP(S) protocol versions 1.1, 2, and 3.
  • Implement and manage egress proxy networks with MITM traffic interception and routing optimization.
  • Extend Chrome DevTools Protocol (CDP) with custom commands to support specialized use cases.
  • Build and maintain scalable WebSocket infrastructures optimized for short-lived, high-volume connections.
  • Design distributed caching systems to support high throughput containerized worker pools.
  • Deploy and manage geographically distributed proxies with automated failover and load balancing.
  • Optimize compute, storage, and traffic costs for high-volume cloud-based services.
  • Proficiency with data parsing, transformation, and storage technologies.
  • Unwavering focus on delivering measurable value to customers