Hacker News
new
past
comments
ask
show
jobs
points
by
SlavikCA
19 hours ago
|
comments
by
SV_BubbleTime
11 hours ago
|
[-]
FP32 is best, although I wonder if there isn’t something better I don’t know about. Q8 is for the most part equal to FP16 in practical terms by being smart about what is quantized, but iirc always slower than FP16 and FP8.
reply