Open Source
Huawei's Computing Systems Lab open-sources MACaQ, a model-agnostic 4-bit quantizer for llama.cpp, vLLM, Diffusers and PyTorch
Huawei Computing Systems Lab in Switzerland released MACaQ on November 10, 2026 under Apache-2.0, together with arXiv paper 2611.10649. The toolkit quantizes text, image, video and audio models one linear layer at a time…