If you are making a decision to spend 50B on hardware, would you use the proven tech stack or rely on engineers taking an unspecified amount of time vibecoding your software stack while the hardware sits idle?
replyHow about in a month or so when you have to run a slightly different workload?
Hyper scalers like Google or Microsoft, which are the big spenders, have all the incentives in the world to get more out of their gargantuan spending.
replyIn fact both of them, actually Amazon too, invest in their own inference hardware and owns the stack.
You can't possibly think that these companies will keep shelling 50-100B per year in hardware alone where 60%+ is margin for Nvidia and not invest there.
if you are developing your own hardware, you provide your own stack to avoid lawsuits with nvidia. i don't think it's a technical problem at all, but a legal one. this is probably why zluda was scrapped by AMD and Intel. Nvidia technically bans the creation of CUDA reimplementations in their TOS if i remember correctly
replyDoesn't Google v Oracle provide protection here? Copying APIs is fair use.
replyIf it's patents that are the problem then presumably all these large semiconductor companies have defensive parent portfolios.
[flagged]
replyi haven't seen it. see the recent browser attempts.
replyYou still need experts to know what is good and what is not.
replyYou just proved that AI cannot currently do that
replyIt can definitely create a software stack for you if you hold it right, but the software stack supported by a trillion dollar company with decades of expertise, that also uses AI to improve its stack is probably gonna be better.
reply