Hacker News
new
past
comments
ask
show
jobs
points
by
drdaeman
4 hours ago
|
comments
by
smallerize
4 hours ago
|
[-]
It is already quantized. You need to convert to GGUF format though. Did your assistant explain this wrong?
reply
by
drdaeman
4 hours ago
|
parent
|
[-]
My bad, I haven’t really looked yet (and haven’t asked any assistants), thought it’s BF16 safetensors as usual, and for those I used to quantize to ggufs with just a couple commands.
reply