Live page · Day archive
Read the original at HF Daily Papers
FOAM is a lightweight SOAP variant that uses input-only preconditioning and a factored Adam-moment estimator to reduce memory and eigendecomposition overhead.
Carried by: HF Daily Papers. First seen: 2026-11-13T06:15:06Z.