upvote
And if you're running it on a dGPU, power limit it, because you lose very little in terms of token generation performance, since it's memory-bound.
reply
Oh. I've been using an icepack under my laptop to keep mine cool. I'm watching it with llamatop to see if the GPU is actually active or not, aw activity monitor wasn't showing me what I wanted.
reply
That's exactly how i fried a laptop. The condensation killed it.
reply