Challenge timeline
- Site, submission portal and evaluation platform live
The scoring backend goes up first so that submission validation and the score path are exercised before any participant depends on them.
- Starter kit released; website opens to participants
Data loaders, the exact metric implementations, reference baselines, example submissions and executed tutorials — the public baselines repo is the reference implementation.
- P1Test phase begins
Workflow and leaderboard validation. Submissions are format-checked and queued; no scores are published and no one is ranked.
- P2Development phase begins; validation leaderboard opens
Submissions for the validation split start being scored, and development scores appear on a public leaderboard. The validation answers themselves are not distributed — a submission comes back as a score.
- P3Final test phase begins
A new held-out dataset. Submission counts are limited in this phase to reduce leaderboard probing.
- Final submissions due; official evaluation starts
Scoring runs on the hidden test sets across both tracks.
- Winners announced at NeurIPS
Final rankings use the hidden test set, not the development leaderboard.
These dates describe the NeurIPS 2026 competition proposal currently under review. Dates, datasets, prize amounts and exact metric formulations may change between proposal acceptance and launch — the evaluation page tracks the metric panel as it stands today.