The same story goes back for years and years in consumer hardware too. AMD GPUs often had more raw compute capability, but fell short in actual game performance (or other applications).
Nvidia's moat is, at least partially, the software to make the hardware useful.
The hyperscalers are one story but research/consumer/“Everyman” inference is likely very different.