upvote
A 3x price difference means you can get 3 256GB mac studios which you can connect through thunderbolt and with RDMA a total of 768GB ram with compute/memory bandwidth scaling basically linearly (with a small overhead cost).
reply
Doesn't make any sense since you can chain 3 M5 Ultra studios for the same price to get 768 which is 2x more than your system.

Lastly, I want to clarify that prefill on an x86 CPU is drastically slower than on an M5 Ultra GPU.

reply
You can find model variants to scale up to whatever capacity you have. Queen has models that just barely fit in 256gb, I ran them… okay… on my Studio.
reply