Hacker News
new
past
comments
ask
show
jobs
points
by
jacquesm
3 hours ago
|
comments
by
kristjansson
2 hours ago
|
[-]
With MTP and FP4 I max out at 30ish t/s on mine. Without MTP or in regimes where the drafter performs poorly it’s about 10 t/s. FP8 is about half that
reply