Salary
💰 $190,000 - $210,000 per year
Tech Stack
AWSCloudDistributed SystemsElasticSearchGoJavaKafkaKubernetesNoSQLPythonScalaSparkSQL
About the role
- Lead architecture and development of high-performance, cloud-native Entity Resolution APIs.
- Design and implement batch and streaming data pipelines using tools like Kafka, SQS, and Spark to build and update the underlying search index.
- Build and maintain low-latency search APIs powered by ElasticSearch or Vespa to support real-time entity linking.
- Collaborate with data scientists to integrate and deploy ranking models to improve search result quality.
- Own the end-to-end lifecycle of applications deployed on Kubernetes, from development and CI/CD to monitoring and scaling.
- Conduct performance tuning and debugging of search systems under high throughput and low-latency requirements.
- Develop tools and metrics to benchmark search quality and system performance.
- Partner with cross-functional teams in data science, infrastructure, and product to deliver reliable, scalable solutions.
- Lead design discussions and planning for backend services that incorporate model inference, SQL/NoSQL and Graph databases.
Requirements
- 8+ years of backend software engineering experience, with 1+ years in a staff/principal-level role.
- Expertise in search technologies like ElasticSearch or Vespa, including deployment, tuning, and query optimization.
- Strong cloud-native experience, especially with AWS services like S3, SQS, Lambda, and Kafka.
- Proven ability to design, build, and maintain distributed systems handling high-volume data streams and real-time requirements.
- Deep knowledge of Kubernetes-based application development and deployment.
- Strong proficiency in one or more backend programming languages (Java, Scala, Go, Python, etc.).
- Experience benchmarking and deploying machine learning models (ranking, reranking, classification) into production search pipelines.
- Familiarity with SQL/NoSQL and Graph databases.
- Eligibility to work in the United States indefinitely without visa sponsorship.
- Candidates residing in Hawaii, Mississippi, New Mexico, West Virginia, or Wyoming cannot be hired.
- Offers Equity
- Offers Bonus
- Comprehensive benefits
- Annual discretionary performance bonus or commission plan
- Market competitive salary
- Remote work (USA)
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard skills
cloud-native developmentEntity Resolution APIsdata pipelinesKafkaSQSSparkElasticSearchVespaKubernetesbackend programming languages
Soft skills
collaborationleadershipdesign discussionsplanning