Hacker News
new
past
comments
ask
show
jobs
points
by
numlock86
15 hours ago
|
comments
by
iaw
3 hours ago
|
next
[-]
On a model of this size quantization has much less impact on quality of output. I'm running a 3bit version and find it comparable to sonnet, almost opus.
reply
by
nicman23
14 hours ago
|
prev
|
[-]
it is not a flat quant but a dynamic
reply