Search Quality Analyst
Perplexity
full-time
Posted on:
Location Type: Hybrid
Location: Belgrade • Serbia
Visit company websiteExplore more
About the role
- Develop data-driven insights from user behavior to inform our product roadmap and accelerate adoption
- Formulate hypotheses and validate them by designing, running, and analyzing A/B tests
- Determine appropriate metrics and visualizations for tracking, and implement them in dashboards
- Design new pipelines that will help to deliver better ranking quality. From discovering new signals, producing metrics and construct data labeling pipelines with human and LLM feedback.
Requirements
- 4+ years of experience working as a data analyst or in a related role
- Experience working on search-related products, with emphasis on designing online metrics and analyzing A/B experiments
- Strong Python skills (expected to write production-grade code)
- Proficiency with SQL
- Experience with Business Intelligence (BI) tools
- Deep knowledge of statistics
- Proficiency with Apache Spark
- Experience with Databricks
- Experience with development of LLM-as-a-judge systems
Applicant Tracking System Keywords
Tip: use these terms in your resume and cover letter to boost ATS matches.
Hard Skills & Tools
PythonSQLA/B testingstatisticsApache SparkDatabricksdata analysisdata visualizationdata pipelinesLLM-as-a-judge systems