upvote
Figuring out what problems to solve or what features to include in the OS.
reply
Go ask an LLM to "do something with 1M tokens".
reply
I think that is a bad argument.

You could ask a human to "do something with 1M dollars" and get garbage too.

reply
The point is that the deciding is the "higher layer." It's not that LLMs cannot, but LLMs as designed do not. They are not designed for free-ranging days off, they are designed to help us do things, and that makes them somewhere between us and published works.

It's no different than an editor standing between the author and a book, or a publisher, or a printing press. It's part of the process of idea realization, so it's just on that spectrum somewhere between book sale and author idea. (even though in another flipflop, that editor might be an author and now elevated to the premier deciding role). It's about how the tool fits, not what the tool is ultimately capable of.

So the analogy holds, just fine.

reply
This terrible argument comes up in relation to AI over and over again. I don’t care if you built a brain surgery robot that outperforms the average person at brain surgery, I care if you built a brain surgery robot that outperforms the average brain surgeon. Outperforming “a human” at a specialist task is still essentially worthless.
reply
> You could ask a human to "do something with 1M dollars" and get garbage too

At least the human's brain requires about 20 Watts to operate.

Cheap garbage is better than garbage requiring whole power plants nad billions of capital investment.

reply
And the human is human.

The idea that we'd have to justify the existence of humans relative to LLMs based on objective metrics sounds like it's leading in a bad direction. If the LLM gets their power budget down to nineteen watts, what does that mean for humans?

reply
I think that the point he’s getting at is the human experience.
reply
> and writes entire operating systems from scratch

ehhhh, we're not really there. Not saying it's impossible to reach in the future but large tasks like this are still out of scope for LLM's beyond demoing toy applications. Impressive nonetheless, but I can't tell an LLM to reproduce microsoft word and have it give me a useful enough tool that doesn't contain an immense amount of bugs and require a human in the loop to replace it.

reply
I would go as far as to say the LLM part has peaked.

To 1-shot MS Word will be possible only within some workspace designed for creating that kind of software. It will probably be saas style where you pay to export binaries or maybe some will take 30% if they become destinations for finding such software.

But I would bet other platforms are used for game dev, or for filmmaking.

Such that we still won’t have some super “model” that just does everything. The harnessing becomes architecture becomes software becomes user experience and expertise.

reply
Non sequitur. Neither most mathematicians nor Terry A. Davis are particularly well known for their literature abilities.
reply
> writes entire operating systems from scratch

Yeah, yeah. Remind me how many people are using those operating systems? The ability of LLMs to produce dogshit software that nobody will ever use is truly unparalleled, but not especially world-changing.

reply