AI Testing Specialist

Job Information

• Industry Informatique
• Date Opened 09/25/2026
• Job Type Full time
• City Warsaw
• State/Province Masovian Voivodeship
• Country Poland
• Zip/Postal Code 00-002

Job Description

We are looking for an AI Testing Specialist to support the validation and continuous improvement of AI/ML models used to detect events in football matches. The role focuses on preparing test datasets, comparing model outputs against annotated ground truth, and evaluating performance using precision, recall, and F1-score. The consultant will analyse errors, edge cases, outliers, and complex visual scenarios, document findings, and work closely with ML teams in an iterative feedback loop to improve model accuracy and reliability. Responsibilities

• Test AI/ML models detecting football match events such as passes, fouls, shots and interceptions
• Prepare test datasets and compare AI results against manually annotated ground truth
• Analyse model performance using precision, recall and F1-score
• Identify errors, edge cases, outliers and unusual scenarios affecting model performance
• Analyse issues such as occlusions, camera angle changes and overlapping actions
• Document findings and provide recommendations to the ML team
• Support annotation and iterative model improvement
• Verify whether implemented changes improve model performance

Requirements

• Master's degree
• 3+ years of relevant experience
• Experience testing / validating AI or ML models
• Experience preparing test datasets
• Experience analysing large datasets for anomalies, outliers and rare scenarios
• Ability to document findings and provide actionable recommendations
• Experience working in an **iterative feedback loop with ML/**AI teams

Benefits

• Solid, competitive salary
• Work in a multinational environment on international projects
• Comprehensive healthcare
• Long-term B2B contract with a stable project pipeline