Live page · Day archive

Loopback Transformer: Towards a Unified View of Residual Looped Transformers

Read the original at HF Daily Papers

Summary

Loopback Transformer reduces parameters by 40-75% while achieving lower validation loss and higher accuracy on ClimbMix and downstream tasks.

Carried by: HF Daily Papers. First seen: .