Challenges
Each score is the geometric mean of a submission's speedup over the baseline on every shape. The score ceiling is the score a submission would reach by hitting the floor on every shape. How to submit explains the rest.
| Challenge | Best score | Score ceiling | Distance to ceiling |
|---|---|---|---|
| inkling2_swa_nvfp4_layer A sliding-window attention layer with NVFP4 experts |
no score yet | 2.09x | not available |
| inkling2_full_nvfp4_layer A global attention layer with NVFP4 experts |
no score yet | 2.06x | not available |
| inkling2_swa_mxfp8_layer A sliding-window attention layer with MXFP8 experts |
no score yet | 1.77x | not available |
| inkling2_full_mxfp8_layer A global attention layer with MXFP8 experts |
no score yet | 1.74x | not available |
| inkling2_dspark_draft The DSpark draft: five layers, the recurrent head and 7 draws |
no score yet | 5.19x | not available |
| inkling2_lm_head The LM head on the final norm's output, and the logits all-gather |
no score yet | 2.49x | not available |
| inkling2_verify_sampling Softcap, stop tokens, rejection sampling of the drafts and the request state |
no score yet | 24.81x | not available |
| inkling2_step_metadata The draft's inputs, and the next step's block tables, slot mappings and inputs |
no score yet | 45.43x | not available |
| inkling2_front The embedding, its all-reduce and norm, the attention temperature and layer 0's norm |
no score yet | 39.88x | not available |