Senior Product Analyst – A/B Testing, Experimentation

the rec hub.

Senior Product Analyst designing and running A/B tests for Aviv Group’s real estate platforms. Influencing product changes through rigorous statistical analysis and experimentation.

Posted 4/27/2026full-timeBelgrade • 🇷🇸 SerbiaSeniorWebsite

Tech Stack

Tools & technologies

NumpyPandasPythonSQL

About the role

Key responsibilities & impact

Design and run A/B tests, sequential tests, and other experimental frameworks from first principles — not just platform configuration.
Apply statistical methods including causal inference, Difference-in-Differences, propensity score matching, and regression discontinuity to measure the true impact of product changes.
Make confident, well-reasoned recommendations when data is ambiguous or experiments are inconclusive — this role requires decision-making under uncertainty, not just analysis.
Partner with product managers, engineers, and designers to define hypotheses, success metrics, and data requirements before experiments begin.
Determine when not to run an experiment — understanding the limitations of your methods is as important as knowing how to apply them.
Build internal models and analytical frameworks to answer product questions that do not yet have data behind them.
Communicate complex statistical findings clearly to both technical and non-technical stakeholders, including making the case for go/no-go product decisions.
Contribute to raising the bar for how experimentation is done across the team.

Requirements

What you’ll need

Hands-on experience designing A/B tests from scratch — including sample size calculation, power analysis, significance thresholds, and choice of test type.
Deep working knowledge of statistical methods and experimental design.
Experience with sequential testing and an understanding of when and why to use it over standard A/B testing.
Familiarity with semi-experimental and quasi-experimental methods — diff-in-diff, propensity score matching, regression discontinuity, or synthetic control.
Strong Python skills for data analysis (pandas, NumPy, SciPy, statsmodels).
Strong SQL for querying and transforming large datasets.
Experience working in a product or consumer-facing business with a user base large enough to run statistically meaningful experiments.
Comfort making recommendations under uncertainty — you give a directional answer with stated assumptions, not a request for more time.
The ability to work fully autonomously. You receive a brief and determine the right methodology independently.
Beneficial: Background in eCommerce, online marketplaces, two-sided platforms, classifieds, CRO, or growth analytics.

Benefits

Comp & perks

20 days annual leave, plus Public holidays, plus company days off
10% performance bonus
Market-leading annual salary
Additional benefits are being added

ATS Keywords

✓ Tailor your resume

Applicant Tracking System Keywords

Tip: use these terms in your resume and cover letter to boost ATS matches.

Hard Skills & Tools

A/B testingstatistical methodscausal inferenceDifference-in-Differencespropensity score matchingregression discontinuityPythonSQLsample size calculationpower analysis

Soft Skills

decision-making under uncertaintycommunicationautonomyrecommendations under uncertaintycollaboration