Hacker News
new
past
comments
ask
show
jobs
points
by
jkingsman
4 hours ago
|
comments
by
Scrapemist
3 hours ago
|
[-]
Trying to get into this too. But my hardware is a bit limited atm. What are you running Q8 on? At what speed?
reply
by
jkingsman
2 hours ago
|
parent
|
[-]
I'm across a Pro 6000, 2x3090, and 128GB sys RAM (built a while back; I could not afford that these days heh). I get ~1-3ktok/s prefill, ~120tok/s decode.
When I had only twin 3090s, I made heavy use of Qwen 3.5 27b.
reply