Hacker News
new
past
comments
ask
show
jobs
points
by
Foobar8568
11 hours ago
|
comments
by
redox99
10 hours ago
|
[-]
Qwen 27B runs very comfortably on a 5090. You need to use Q4 quants and Q8 KV cache. Here's the math
https://news.ycombinator.com/item?id=49514141
reply