There seems to be a moat like infrastructure/gpus and talent. The best models right now come from companies with considerable resources/funding.
replyRight, but that's a short term moat. If they pause on their incredible levels of spending for even 6 months, someone else will take over having spent only a tiny fraction of what they did. They might get taken over anyway.
reply> someone else will take over having spent only a tiny fraction of what they did
replyHow. By magic? You fell for 'Deepseek V3 is as good as SOTA'?
By reverse engineering, sheer stupidity from the competition, corporate espionage, ‘stealing’ engineers and sometimes a stroke of genius, the same as it’s always been
reply