Challenge timeline

  1. Site, submission portal and evaluation platform live

    The scoring backend goes up first so that submission validation and the score path are exercised before any participant depends on them.

  2. Starter kit released; website opens to participants

    Data loaders, the exact metric implementations, reference baselines, example submissions and executed tutorials — the public baselines repo is the reference implementation.

  3. P1
    Test phase begins

    Workflow and leaderboard validation. Submissions are format-checked and queued; no scores are published and no one is ranked.

  4. P2
    Development phase begins; validation leaderboard opens

    Submissions for the validation split start being scored, and development scores appear on a public leaderboard. The validation answers themselves are not distributed — a submission comes back as a score.

  5. P3
    Final test phase begins

    A new held-out dataset. Submission counts are limited in this phase to reduce leaderboard probing.

  6. Final submissions due; official evaluation starts

    Scoring runs on the hidden test sets across both tracks.

  7. Winners announced at NeurIPS

    Final rankings use the hidden test set, not the development leaderboard.

These dates describe the NeurIPS 2026 competition proposal currently under review. Dates, datasets, prize amounts and exact metric formulations may change between proposal acceptance and launch — the evaluation page tracks the metric panel as it stands today.