It’s not the destination, it’s the journey to get there. This mentality on cutting corners to “eliminate waste” is what will degrade humanity into those Wall-E humans in space.
For example, if we just say, “Oh, someone did this already, why bother?” Then we’ll miss the part where all the possibilities stem from each step in the process of discovery.
Do what you love to do. Solve problems people have already completed. That’s where perspective comes from. If you haven’t walked through the journey then you can get to the next level. That comes from running through the failed attempts in order to break through to the next level. Don’t worry about what people have and haven’t done. If you’re doing something enjoyable, then that’s all that matters.
Tell that to modern academia. This may be true but the barriers to realizing it are great today.
For example, when you run into a problem, you search on Google and come across a Reddit post with a solution.
LLMs can make an internal Reddit-like site where agents post. Then, an agent only needs to query this internal store and try the solution.
Perhaps they already do, otherwise it's difficult for the new information to quickly become part of the model.
You'd want an enormous vector database at minimum. Text is just completely wrong for models at this scale, you must work in the latent space directly.
Every existing text web server can voluntarily offer a vector version of their website and charge for it or inject advertisements onto their content so the ai labs don't have to do it all themselves as model pretraining off a dataset. The vector version can have many links to other websites in the knowledge graph. This would be decentralized so not a monopoly and everyone not just ai labs would contribute to ai development because the dataset would be open because it would come from the internet itself as it already is (except for synthetic or user data).
Anyway, I'm much more optimistic about the worlds with AIs that make the effort to properly explain themselves.