upvote
I’ve run the numbers on this, and an optimized nVidia build can meet or beat Apple platforms in terms of tokens per watt, which is the most important efficiency metric if what you care about is using the least amount of energy to generate a given response.

Yes, the Mac might get lukewarm, but it will take 2-3+ times longer to do the same task.

reply