Paper
Hugging Face
ActObs supervises environment-observation tokens during SFT, not just actions, yielding higher pass@k after GRPO on Terminal-Bench 2.0 and cross-domain code editing without extra data.
Qwen3-8B pass@16 gain +3.4ppaider-polyglot pass@1 gain (4B) +4.2pp
Why it matters
- Simple training-signal change with no added compute cost that measurably improves downstream RL exploration.
- Traces the mechanism to orthogonal action/observation gradients during SFT, a reusable diagnostic for other agent setups.
Paper
Hugging Face
RetireOPD trains a skill-conditioned teacher then has a skill-free student adaptively drop the teacher once it nears the teacher's success rate, improving ALFWorld and WebShop over RL baselines.
ALFWorld success rate gain +14.1% to +18.8%WebShop accuracy gain +11.8% to +19.0%
Why it matters
- Adaptive retirement avoids the guesswork of predefined distillation schedules used in prior self-distillation recipes.
Paper
Hugging Face
When2Think uses reward shaping keyed to pre-computed difficulty statistics to teach a model when to think versus answer directly, cutting token usage while improving Pass@3 on AIME24/25.
AIME24 Pass@3 gain +10.0%AIME24 token reduction -27.9%AIME25 Pass@3 40.0%
Why it matters
- Addresses the overthinking-easy/underthinking-hard failure mode without a learned reward model or online reference queries.
Paper
Hugging Face
Identifies termination-token mismatch between base students and post-trained teachers as a key driver of runaway response length in on-policy distillation across Qwen3, Llama, and Gemma.
Why it matters
- Explains a previously puzzling failure mode (budget-exhausting responses) with a concrete, fixable mechanism.
Paper
Hugging Face
Using a new 5,319-problem math suite, finds reference-free self-distillation accounts for most gains attributed to teacher-privileged information, which mainly helps cross-mode transfer.
Why it matters
- Questions how much value teacher references actually add versus distillation itself, informing cheaper training recipes.
Paper
Hugging Face
EvoSkill-GUI lets GUI agents revise structured skill packages from execution feedback at deployment time with no additional training, improving performance on MobileWorld, AndroidWorld, and OSWorld.
MobileWorld gain +16.2%AndroidWorld gain +6.0%OSWorld gain +10.5%
Why it matters
- Deployment-time skill revision means agents keep improving after shipping instead of needing retraining.
Paper
Hugging Face
At fixed candidate count, eight sequential single-candidate generation calls use up to 4.9x the GPU energy and 6.1x the P95 latency of one batched eight-candidate call on A100s.
Energy overhead, serial vs batched 4.64x-4.86xP95 latency overhead 5.77x-6.12x
Why it matters
- Argues evaluations should report generation schedule and GPU-level systems metrics, not just candidate count and accuracy.