Hacker News
new
past
comments
ask
show
jobs
points
by
bityard
22 hours ago
|
comments
by
Catloafdev
20 hours ago
|
[-]
Q8 is virtually lossless. The quantization is much more noticeable around Q4 and below. FP16->Q8 on consumer hardware is 2x the speed at ~99.99% the quality.
reply
by
rvba
11 hours ago
|
parent
|
[-]
Any source that confirms the 99.99% quality?
reply