upvote
But their goal would be to ensure it only runs on their chips, and not any competitors. I can't see how they could do that if the best models truely were "Open".

I can see one of Nvidia's biggest fears is the inference hardware becoming commoditised.

reply
The existence of inference ASICs has been priced-in to Nvidia's stock since Google started designing TPUs. It's not that new, really.

What Nvidia has the market cornered on is flexible GPU architectures. Nobody else has stepped up to the plate on that, and it's how Nvidia will butter their bread with robotics and future model training efforts.

reply
can someone weigh in on this. what's the actual play here

are they actually suppressing the western open models?

china doesn't give a fuck either way

imo, they see the weakness emerging at the intersection of all the labs, everybody knew there was no moat, so they're gonna control its direction and basically tell the Jev guys what they want them to work on

reply
It’s just an illogical conspiracy theory. Open weights models still have to run on someone’s chips. NVIDIA is model-agnostic.

They are just trying to grow the pie because they have nobody else competing for slices.

My guess is they want as many frontier models using their chips as possible. The only threat to their business is companies making their own chips which Google does and the others are working toward. The last thing they want is only 3 frontier labs who are all not buying NVIDIA.

reply
yes, this is my read as well. Nvidia does not care about how many LLM provider is out there as long as they pay the toll (Nvidia tax). for now, you can't beat the Nvidia CUDA/chip for training but for inference. that's where you can gain ground.

Hugging Face - distribution for model that you can run on your local Nvidia Spark

Neoclouds - Nvidia setup a 500 billion investment fund with Wall Street so Nvidia can sell chip and this news about buying a LLM start up. it seem like another customer for Nvidia.

correct me if i'm wrong but i remember i saw an interview with Jensen where he want more company to have their own model and country to have their own LLM model.

Nvidia doesn't make money from the gold rush. Nvidia made money from selling the shovels.

reply
Ah yes sovereign AI

But we’re getting ahead of ourselves

reply
Watch what they do and not what they say.
reply