Hacker News
new
past
comments
ask
show
jobs
points
by
brandall10
21 hours ago
|
comments
by
sfifs
6 hours ago
|
[-]
Used both. DeepSeek-4 Flash Q2 - last 6 layers Q4 quant with DwarfStar which just about fits in 128Gb is definitely superior IMO - my contexts tend to run typically 50-100k. Throughput tends to be about 12-13k tok/sec - just about acceptable.
reply