Kernel Judge

Challenges

Each score is the geometric mean of a submission's speedup over the baseline on every shape. The score ceiling is the score a submission would reach by hitting the floor on every shape. How to submit explains the rest.

ChallengeBest scoreScore ceilingDistance to ceiling
inkling2_swa_nvfp4_layer
A sliding-window attention layer with NVFP4 experts
no score yet 2.09x not available
inkling2_full_nvfp4_layer
A global attention layer with NVFP4 experts
no score yet 2.06x not available
inkling2_swa_mxfp8_layer
A sliding-window attention layer with MXFP8 experts
no score yet 1.77x not available
inkling2_full_mxfp8_layer
A global attention layer with MXFP8 experts
no score yet 1.74x not available
inkling2_dspark_draft
The DSpark draft: five layers, the recurrent head and 7 draws
no score yet 5.19x not available
inkling2_lm_head
The LM head on the final norm's output, and the logits all-gather
no score yet 2.49x not available
inkling2_verify_sampling
Softcap, stop tokens, rejection sampling of the drafts and the request state
no score yet 24.81x not available
inkling2_step_metadata
The draft's inputs, and the next step's block tables, slot mappings and inputs
no score yet 45.43x not available
inkling2_front
The embedding, its all-reduce and norm, the attention temperature and layer 0's norm
no score yet 39.88x not available