Live page ยท Day archive

ggml-org/llama.cpp v0.9.0

Read the original at GitHub Releases

Summary

ggml-org releases llama.cpp v0.9.0, adding OCP FP8 E4M3 quantization, flash attention support, and four new model architectures.

Carried by: GitHub Releases. First seen: .