Live page · Day archive

On-Policy or Off-Policy Learning? A Systematic Study of Distillation Dynamics

Read the original at HF Daily Papers

Summary

Researchers find that token-level KL direction shapes performance in Llama3 and Qwen2.5 distillation, while rollout policy plays a less central role.

Carried by: HF Daily Papers. First seen: .