Hacker News
new
past
comments
ask
show
jobs
points
by
bityard
8 hours ago
|
comments
by
UncleOxidant
4 hours ago
|
[-]
That's the one I'm running using a fork of the gufo inference engine as gufo upstream doesn't support that quant.
reply
by
Zetaphor
4 hours ago
|
parent
|
[-]
I'm running a regular Q4, what about that quant format justifies the fork?
reply