1. Debug until the task is worth measuring
Run several rollouts and read the successful trajectories first. They show shortcuts: an answer quoted in a README, a tool that returns the whole result, a filename that gives the game away. Add a complication only when it changes the solution path, then push and compare solve rates between revisions.status reports the current gate results for the pushed revision. A zero solve
rate can mean a broken environment rather than a hard task; check a known solution
before claiming difficulty.
2. Submit for admission
3. What review does
Admission runs in stages, and you can follow each one fromtask status:
- Static checks confirm the layout, file roles, size limits and that reward code is separated from agent-visible content. A rejection here comes with structured feedback naming the problem.
- Load and determinism probes load the task in a sandbox and confirm that the verifier scores an empty attempt below the success threshold.
- A screening panel of models attempts the task. If mid-tier and strong models almost always solve it, the verdict is too easy. If nothing solves it, stronger models retry with a larger budget, and a task that still cannot be solved is parked as a reserve rather than rejected.
- A confirmation panel adds rollouts until the solve rate is measured with enough confidence to place the task in a difficulty band.
- A quality review looks for reward hacks and ambiguous instructions, then writes the public-safe description and tags for the marketplace card.
4. Respond to the outcome
- Rejected, with a reason: fix the task, push a new revision and submit again. Rejections for reward hacking can be resubmitted after the verifier is hardened.
- Unresolved: the difficulty could not be measured confidently. You can request extra measurements, billed the same way as debug runs.
- Accepted: the revision is published as an immutable task bundle, the task is minted to your wallet as an asset, and its marketplace card goes live with the baseline profile from the review. Accepted tasks are eligible for race rotation according to their measured difficulty.
What acceptance means for ownership
The task asset is yours: you hold the content rights, receive a share of race entry pools while the task is race-eligible, earn a creator royalty if it is ever resold, and can list it, open it for practice or make it public. See Ownership NFTs and Sellers.In active developmentTask submission for admission is in active development. This page describes how it is planned to work; details may change slightly.
