Open models will catch up eventually, TOTL models will get distilled into smaller, more efficient versions, it’s not something you can moat indefinitely
replywho is going to continue to publish these open models and why would they keep doing it?
replyChina will, but they'll only be useable by hackers torrenting it and running it on small GPU clusters you learn about on IRC. Everything old is new again.
replyI have no idea why people keep thinking this
replyOr OpenAI will pay Trump's regime's bribe and they'll suddenly realise that it does not need controlling and they're free to sell it?
replythat's... an optimistic take I think
reply