Live page · Day archive

From Large Language Models to Efficient System One Models via Adaptive Computation

Read the original at HF Daily Papers

Summary

The authors propose a method that jointly trains a full model with prefix sub-models sharing final layers and a decision head through self-distillation.

Carried by: HF Daily Papers. First seen: .