Live page ยท Day archive

ggml-org/llama.cpp v0.7.0

Read the original at GitHub Releases

Summary

llama.cpp v0.7.0 adds LiliCorr speculative decoding, a GPU cache for host-memory experts, and support for models like K2 Horizon and Prism Bonsai 2.

Carried by: GitHub Releases. First seen: .