There’s no reason to believe that companies running open weights models would use consumer hardware. I can speak on behalf of my employer and say that we’d vastly prefer to have enterprise grade servers running inference on premises.

Not consumer demand. I was assuming that it's Nvidia's interest that intelligence is not only in a couple of frontier lab's hands, or they can choke the demand to suit their needs. If any company can access a frontier model without going through the frontier labs, the ecosystem will be larger and healthier for everyone, including Nvidia.

I think the vast majority of gpu’s serving open models are in those data centers

Open weights models in the data center are more important than on consumer devices.

In the future, even consumers will launch weights and fine tunes they own in the cloud.

People don't own the fiber to their home, so why should they expect to run the GPUs? If they want smart coding and video models, they'll need H200s and B200s, and they'll need to rent them.