Live page ยท Day archive

ProVe: Proposer-Verifier Decoding

Read the original at HF Daily Papers

Summary

ProVe reverses speculative decoding roles, using a large model to propose token blocks and a smaller model to verify them for faster inference.

Carried by: HF Daily Papers. First seen: .