Refine tasks based on observed agent behaviour and evaluation results.
Identify implementation errors, flawed assumptions, data leakage, and other issues affecting solution correctness.
Validate solutions through reliable testing and verification procedures.
Document task requirements, solution reasoning, and verification steps clearly.
REQUIRED QUALIFICATIONS
Expert rank or above on Kaggle or a comparable competitive data science platform.
Demonstrated experience participating in competitive data science or machine learning challenges.
Strong mathematical reasoning and problem-solving capabilities.
Clear understanding of the methods and techniques used to develop solutions.
Practical programming ability sufficient to independently implement, test, and verify solutions.
Ability to build reproducible environments and develop reliable evaluation workflows.
Strong analytical skills and attention to technical accuracy.
RELEVANT COMPETITION PLATFORMS
Experience with one or more of the following platforms is relevant
Kaggle
DrivenData
Zindi
AIcrowd
Numerai
DataSource.ai
CodaLab / Codabench
PREFERRED QUALIFICATIONS
Strong Python programming experience.
Experience with software testing, debugging, and working with unfamiliar codebases.
Ability to identify data leakage, methodological errors, and weaknesses in model evaluation.
Experience developing reference implementations and automated validation systems.
Familiarity with coding agents and AI-assisted software development workflows.
WORK ARRANGEMENT AND AVAILABILITY
Fully remote, open to candidates globally.
Approximately 15 hours per week.
Flexible working hours and days, including weekends.
Independent, task-based technical work.
COMPENSATION STRUCTURE
Indicative hourly rate: $60–$120.
Illustrative annualized equivalent: $43,200–$86,400, based on 15 hours per week over 48 weeks.
Output-based payment, with compensation tied to tasks that meet project specifications.
Actual earnings depend on task complexity, completion time, and approved submissions.
Annualized compensation is an illustrative equivalent based on the stated 15 hours/week × 48 weeks/year. Actual earnings depend on hours worked, project availability, task completion, and approved work.