Live page · Day archive

Latent Feedback Is a Compute and Data Amplifier

Read the original at HF Daily Papers

Summary

Latent feedback amplifies compute and data efficiency in Transformers by feeding token states into subsequent inputs, reducing required resources for equivalent performance.

Carried by: HF Daily Papers. First seen: .