Hacker News
new
past
comments
ask
show
jobs
points
by
prometheus1992
12 hours ago
|
comments
by
Balooga
11 hours ago
|
next
[-]
Now I'm feeling pretty good about getting 10-11 tokens/sec running Qwopus 3.6-35B-A3B Q6_K on an old Mac Pro 2013 (trashcan) with 128GB RAM (DDR3), 12 core Xeon, dual D700s. Arch Linux and llama.cpp.
reply
by
prometheus1992
10 hours ago
|
parent
|
[-]
haha, good for you.
reply
by
trollbridge
8 hours ago
|
prev
|
next
[-]
Anything smaller than a 16” runs into serious thermal problems; even an identically equipped 14” just can’t dissipate enough heat.
reply
by
carloslfu
11 hours ago
|
prev
|
[-]
interesting! Yes, thermal is important. Pretty cool project man! Starred and checking it out!
reply