Live page · Day archive

Continually Post-training Small Models via Synthetic Self-distillation

Read the original at HF Daily Papers

Summary

Researchers introduce SynthSelf, a method that uses a larger same-family model to generate training data for smaller models, enabling them to learn new tasks while retaining existing knowledge.

Carried by: HF Daily Papers. First seen: .