The DGX are certainly making a case for a new workstation platform to compete with Apple. The user experience is on par, and the local model capabilities are very appealing in many use cases. I've been happy to have had a pair to play with anyway .. I sure hope the price comes down and Nvidia expand the concept ..
replyFor now the prices seem to be only going up. It is complete madness. At the same time: I'm kind of happy about that. It means that lots of people and small to mid sized organization have a very nice incentive to make low end hardware perform better. If you look at how much effort is being poured into model compression and clever VRAM management schemes on the low end it is quite impressive. And plenty of those are compounding.
replyI wished they had a bit more memory bandwidth though, this is quite annoying.