Live page · Day archive

DepthGraft: Structural Regularization through Hierarchical Cross-Layer KV Reconstruction

Read the original at HF Daily Papers

Summary

DepthGraft is a hierarchical KV-sharing architecture that reconstructs deep-layer keys from shallow-middle sources to reduce cache size by roughly one third.

Carried by: HF Daily Papers. First seen: .