Read the original at HF Daily Papers
DoSA accelerates sparse attention by conditionally scoring keys using evidence-based rejection. It achieves up to 2.74 times faster indexing over SGLang and 1.69 times over LiteTopK.
Carried by: HF Daily Papers. First seen: .