upvote
Huawei releases MACaQ, its internal quantizer for local inference

(github.com)

People are reproducing it and creating GGUFs https://www.reddit.com/r/LocalLLaMA/s/36atJ2nNjh
reply
The top 3 repos sorted by stars on Huawei's github page are all for quantization. I am not an LLM scientist so I can't tell what the difference is between them, or why they need three different pipelines for model quantization.
reply
https://huawei-csl.com/blog/macaq/

Why does some HN users seem to prefer GitHub page whenever available at expense of official site? I mean, Huawei is still sanctioned, anything they host third party outside China can disappear at any hour.

reply
I prefer GitHub, because I can see the code and immediately know where to click. Product pages are always full of various marketing shots, videos, etc that just takes more time to parse through.
reply
This is pretty much the reason that if I read about a new product, I generally just go to the Wikipedia page. I just want the no-bullshit version, no "Say hello to blah" video or marketing word salad.
reply
In this particular case I think you'd be pleased with it https://huawei-csl.com/blog/macaq/

It is from their lab in Switzerland, after all.

reply
Looks like many of their repos there have been around for a while. Also not sure why we would sanction free stuff from them
reply
Well I'm not a lawyer but are you allowed to provide material support to sanctioned entities?
reply
It’s a commerce department sanction not a treasury department sanction (which would be far more serious).
reply
[dead]
reply
Did they release any model? Seems good for Strata
reply
Qwen 3.8 27B has a macaq quant available
reply
What a project name.
reply
Probably intended to reference macaque monkeys.
reply
I forgot my French, but isn't it incredibly rude?
reply
Why?
reply
I think the immature commenters are referring to the pronunciation being similar to "my cock"
reply
Aaa, thanks I didn't think of that.
reply
Congratulations on not being a total degenerate.
reply
It's also a racial slur in certain languages.
reply
It's also "Roach" in Hebrew (מקק)
reply
What are those?
reply
No, no, not that.
reply
I'd assume the French know something about naming projects in the vein of Coq.
reply
[dead]
reply
deleted
reply
I do not think that macaques would mind.
reply
Just enough plausible deniability :P
reply
deleted
reply
[flagged]
reply
[dead]
reply
[dead]
reply
deleted
reply