以下为上游提供的源文稿,可能存在识别错误。
乔木转写是基于源文稿的中文提炼,不是逐字翻译。请核对原文中的人名、数字与观点。
选一篇,慢慢读
从左侧挑一篇,正文会在这里排成书页。
On-Policy Self-Distillation (OPSD), which aligns a student model's token-level distribution with that of its self-teacher prompted by privileged context, has emerged as a promising direction to mitigate reward sparsity in sequence-level post-training paradigms. However, OPSD often fails to achieve continuous performanc
阅读原文 · Shufan Shen, Zhongni Hou, Chao Bi, Yufei Zhang, Guojun Yin, Shuhui Wang
向阳乔木 · opencode-go/deepseek-v4.1-flash
这篇论文盯上的是后训练里一个很实际的痛点:序列级奖励太稀疏,模型很难从一次成败里学到东西。On-Policy Self-Distillation(OPSD)的思路是让模型自己当老师,在带特权上下文的情况下给出 token 级分布,作为更细的监督信号。 但作者发现一个尴尬现象:OPSD 训着训着就不涨了。他们把原因归到 自教能力有限 ,也就是某些样本上老师给出...