You could ask a human to "do something with 1M dollars" and get garbage too.
It's no different than an editor standing between the author and a book, or a publisher, or a printing press. It's part of the process of idea realization, so it's just on that spectrum somewhere between book sale and author idea. (even though in another flipflop, that editor might be an author and now elevated to the premier deciding role). It's about how the tool fits, not what the tool is ultimately capable of.
So the analogy holds, just fine.
At least the human's brain requires about 20 Watts to operate.
Cheap garbage is better than garbage requiring whole power plants nad billions of capital investment.
The idea that we'd have to justify the existence of humans relative to LLMs based on objective metrics sounds like it's leading in a bad direction. If the LLM gets their power budget down to nineteen watts, what does that mean for humans?
ehhhh, we're not really there. Not saying it's impossible to reach in the future but large tasks like this are still out of scope for LLM's beyond demoing toy applications. Impressive nonetheless, but I can't tell an LLM to reproduce microsoft word and have it give me a useful enough tool that doesn't contain an immense amount of bugs and require a human in the loop to replace it.
To 1-shot MS Word will be possible only within some workspace designed for creating that kind of software. It will probably be saas style where you pay to export binaries or maybe some will take 30% if they become destinations for finding such software.
But I would bet other platforms are used for game dev, or for filmmaking.
Such that we still won’t have some super “model” that just does everything. The harnessing becomes architecture becomes software becomes user experience and expertise.
Yeah, yeah. Remind me how many people are using those operating systems? The ability of LLMs to produce dogshit software that nobody will ever use is truly unparalleled, but not especially world-changing.