Specifically Dwarkesh couldn't understand that GPUs are not enough: it's GPUs plus multiple ecosystems to leverage them at massive scale during training vs inference.
replyInstead of giving China open access to US controlled chips and creating a misalignment between labs that want to train a model on whatever is best, and hardware manufacturers that need labs to suffer the growing pains for their new ecosystems built from scratch... we removed the option from the board and now they've beat the growing pains decisively, with a speed that reflects the non-optionality.
I don't listen to Dwarkesh but I'm aware of who is and his influence. I was baffled that he could not understand it...Don't know if he had his own agenda or just not intelligent (which is scarey for someone with influencec), but I sensed the frustration in Jensen Huang for something that is fairly obviously.
replyThe same scenario happens all the time when the US takes away something from China and China doubles down, gets into survival mode and then beats the US.