Live page · Day archive

Recovering Reliable Supervision via Critique-Guided On-Policy Distillation

Read the original at HF Daily Papers

Summary

Researchers introduce CriticOPD, a method that uses teacher critiques to correct student model errors during on-policy distillation, improving performance on mathematical reasoning benchmarks.

Carried by: HF Daily Papers. First seen: .