"It's better than you, and if it isn't, it's bigger than you."
reply> Do you remember GPT-2?
replyI recall them saying it was too dangerous to release, funny how they are only saying that again as they look to IPO
This is going to sound crazy, but, at the time, they were spooked by Neal Stephenson's June 2019 book The Fall -- where the internet was broken by the open-source release of something akin to a language model that generated endless quantities of spam. They thought that GPT-2 might be that invention, so it worried them.
replyThen, a few years later, they learned that Google and Anthropic were planning on releasing LLM chatbots to the public, so they hastily launched GPT-3.5-based ChatGPT as a "dev preview" to get ahead of them. Their original plan was to finish training GPT-4 before launching anything.
Commercial considerations -- and public glory -- triumphed in the end.
<< people are starting to panic that there are no brakes on this thing.
replyThere are.. physical limits, as it were, which effectively restrict upper limit, but I hear what you are saying. A lot of the problems thrown at it and issues found in the process only seem to have helped. I feels ages ago when we were arguing 'it is merely a stochastic parrot'.
deleted
reply