Paper
Hugging Face
DCOCO restores intra-block token dependencies for parallel diffusion drafters by scoring candidate tokens' contextual compatibility, reaching up to 6.6x speedups over vanilla decoding.
Max speedup vs vanilla decoding 6.6xGain over best competitor under load 6-23%
Why it matters
- Highest average throughput across four verifier backbones and ten benchmarks, including under extended reasoning.
- Outperforms the strongest competing corrector by 6-23% under concurrent serving loads of 4-32 requests.
Paper
Hugging Face
UTT distills teacher-student knowledge gaps into a reusable natural-language "Primer" with no parameter updates, raising a student's KernelBench accuracy from 9.4% to 48.6%.
KernelBench accuracy gain 9.4% to 48.6%Math reasoning accuracy gain 27.6% to 51.7%
Why it matters
- Works for API-only or costly-to-train teacher models since it requires no weight access on either side.
- A Primer synthesized for one teacher-student pair generalizes to other students that never participated in its creation.
Paper
Hugging Face
Across 17 teacher-student pairs from 1.5B to 235B parameters, distilling from offline student rollouts (Semi-OPD) beats on-policy distillation in 14 of 17 cases.
Pairs where Semi-OPD wins 14 of 17Max training speedup 11.4x
Why it matters
- Up to +13.6% accuracy and 11.4x training speedup over on-policy distillation when teacher and student are misaligned.
- On-policy distillation only wins when teacher and student output-token overlap is already high, giving a concrete criterion for choosing a method.
Paper
Hugging Face
PreSTO prefetches batches of future Metropolis-Hastings proposals for power sampling, cutting model calls roughly 3.9x while leaving the sampler's transition kernel unchanged.
Median speedup range 1.71x-2.33xFewer model calls 3.9x
Why it matters
- Median speedups of 1.71x-2.33x across PowerMH and its EntropyCut and MultiTryMH follow-ups on seven datasets and five base LLMs.
Paper
Hugging Face
Entropy- and alignment-based layer-selection for EAGLE3-style speculative decoding outperforms the fixed-position default, with a clearer account of why simple heuristics sometimes stay competitive.
Paper
Hugging Face
SynthSelf outsources in-distribution rewriting to a minimally larger same-family aligner, letting small models continually learn new capabilities without forgetting, across 4 acquisition datasets and 14 retention benchmarks.