Thoughts on a M5 Ultra 768GB if it drops? What's the price to make it worth it for you over a spark cluster?
replyI'm wanting to run Kimi 2.6/2.7 GGUF on it and just slap it in the server rack, but trying to decide if a spark cluster makes more sense.
The M3 with 512GB is currently sitting at around 30K, used. You can extrapolate from there.
reply[dead]
reply