Senior Product Data Scientist
BetterUp
PythonSQL
Job Level
Senior
Tech Stack
Python
About the role
- Location: Remote (Poland preferred)
- Start Day: ASAP
- Engagement: Part-time (with potential to transition to full-time)
- Language requirement: Polish – mandatory
- Contract type: B2B only
- Salary rate: up to 125PLN net+vat/h
- We are looking for a QA Engineer to join the client’s team working on Python-based web applications integrated with AI/ML components.
- This role combines traditional software testing with quality assurance for predictive models and data pipelines.
- Design and execute test scenarios for Python-based web applications
- Assess AI model performance using metrics such as precision, recall, F1-score, bias, fairness, and explainability
- Conduct robustness testing and validate data quality used for training models
- Work with tools supporting AI/ML model testing (e.g. MLflow, TensorBoard, Great Expectations, Evidently AI)
- Cooperate with data scientists and engineers to define QA standards for data-driven systems
- Apply testing methodologies suited for predictive, model-based architectures
Requirements
- Experience testing web applications (especially in Python environments)
- Fluency in Polish (for communication, documentation, and collaboration)
- Understanding of the difference between classical software QA and data/model-based testing
- Practical experience in testing AI/ML models or data validation processes
- Familiarity with model performance metrics (precision, recall, F1-score)
- Exposure to tools such as MLflow, TensorBoard, Great Expectations, Evidently AI
- Experience with fairness, bias, or explainability validation of AI systems
