Live page ยท Day archive

On-Policy Self-Distillation with Teacher Evolution

Read the original at HF Daily Papers

Summary

Teacher-Evolution Self-Distillation improves sequence-level post-training by enhancing self-teaching capability and down-weighting unreliable guidance samples.

Carried by: HF Daily Papers. First seen: .