This is also my experience, but when I saw how few tokens/second with a large model it gets locally I was bummed. I’m wondering if I’ll be obligated to upgrade in the near future
replyInteresting. I have the same machine w/ same specs. I find it sluggish. I think it depends on what you're doing.
replyYou might want to do a full restore or something, my M1 Max isn't sluggish at all.
replyI recently upgraded to Golden Gate, and that helped a bit, but it still feels sluggish.
replyWhat are you doing with yours? I recently started using Android/iOS emulators locally and combined with anything else my M1 Pro 32 GB feels unusable.
replyDefinitely grabbing 128 GB + for the next machine.
In this economy?!
replyI jest...but I'm disgusted by the price gouging going on. Glad my hardware is relatively recent and I had mostly maxed out already when I bought it a few years back. The same setup today would be closer to $7k with equivalent parts.