My biggest problem with buying a Mac Studio is that even in the case of the M5 Max models, I can’t think of any non-AI macOS applications in my creative life that have anywhere near that level of hardware requirements, and nor can I forecast that I would within its ordinary supported lifespan as a macOS machine. These machines left high-end stills and most video work behind generations ago, for example.
So while I would like a local machine that I can leave running in a way that I wouldn’t want to do with my old secondhand M1 Max laptop, it’s going to have to be something a little more pragmatic. Probably based around the Radeon R9700, since the AMD/Nvidia gap for LLMs is beginning to close, and even a single R9700 runs the main models I am interested in at speeds that are acceptably faster than what I have here.
At the moment, speccing out a local box more powerful than the machine I am using is largely an intellectual exercise, but it does have some value for understanding what a client might be able to use if they absolutely require on-premises inference, and I do have a couple who fall into that zone. So I am trying to keep up to date in principle, but the built machines don't get beyond the shopping cart.
The M5 Ultra has probably smoothed out the major issues of AI on Apple Silicon (prefill doesn't suck anymore) but the way Apple marketed that chip strongly suggests they are now fully aware of the strengths but also the limitations of their architecture and will get a lot more done.
It's properly put the (fairly equivalently priced) DGX Spark in the shade, though.