Hacker News
new
past
comments
ask
show
jobs
points
by
embedding-shape
11 hours ago
|
comments
by
regularfry
9 hours ago
|
[-]
They're claiming 20+tps inference on a macbook with the unsloth quant.
reply
by
embedding-shape
6 hours ago
|
parent
|
[-]
Yeah, I'm guessing the Mac users still aren't very fond of sharing the time the prefill takes, still. They usually only share the tok/s output, never the input.
reply