upvote
1-2 RTX5090 will be better value than Macs because they have the memory bandwidth for somewhat fast local inference.
reply
If you don't want to wait for prefill, you're going to want a CUDA dGPU system.
reply