The irony here is, thats hobby hardware. You spend 20k and can run slow hobby models that are barely capable of anything unsupervised.
replyEntry level serious hardware starts at 100k, and a bit better but still almost-useful grade is 200k (8x rtx pro, plus a nice epyc pairing). Thats the sort of thing a salaried expert lets their employer buy them for sort of serious work.
Anything really serious is well north of 1M - not including the housing and commercial grade mains connection. And at best that buys fast Kimi K3 or GLM.
You can run Deepseek 4 flash on a 128gb Mac, comfortably with lots of cache and context on a 256gb one.
replyThese models are not 'barely capable', they're contemporary near frontier.
I do have a 128gb mac, and the experience is, for my use cases, hobby grade. I use models on a daily basis for design work (chiefly), and sometimes implementation work. I can't justify a drop in output quality and significantly increased waiting time. Sure, if frontier did not exist, I'd use them, but way differently than fable or astra.
replyIf I had 0 privacy concerns I could just use deepseek directly in the cloud but the whole point is to not put your data on someone else's computer.
reply