Hacker News
new
past
comments
ask
show
jobs
points
by
Tepix
5 hours ago
|
comments
by
rpdillon
4 hours ago
|
[-]
Quants vary by model. DS4 is very credible at a 2-bit quant. Not sure about Qwen 3.8 Flash Next; I run it at a 4-bit quant and it's too slow, so I'm trying out DwarfStar today to see if that improves things.
reply