Hacker News
new
past
comments
ask
show
jobs
points
by
abalashov
2 hours ago
|
comments
by
throwawayffffas
1 hours ago
|
[-]
Nah, you can run the 24b - 35b class with between 90k and 256k of context with about 40GB and they are pretty good. Especially the MOE variants fit neatly in 40GB.
reply