Live page · Day archive

Huawei releases MACaQ, its internal quantizer for local inference

Read the original at Hacker News

Summary

Huawei releases MACaQ, an internal quantizer for local inference that supports model-agnostic quantization for GGUF, local inference and beyond.

Carried by: Hacker News. First seen: .