Okay here's something LLMs can't. They can't solve problems that are longer than ~10 pages of math. They also can't maintain codebases without supervision. It's because they are have no memory and use various tricks to supplant that fact.
replyNow, how long before someone rolls out some sort of 10M context hybrid attention active context management monstrosity and ruins this guy's "can't"? Start the clock.
replyMy opinion of claims like "LLMs need memory to manage codebases" has also hit the dumpster bin a while ago.
Why would knowing how to make a maintainable change to a codebase require any more "memory" than knowing how to play an optimal chess move? The codebase is the memory. A sufficiently capable LLM can ingest it, figure out what changes to make, and make them.
> The codebase is the memory.
replyWere that the case LLMs would’ve been phenomenal code monkeys from the get go. They were not. They still are not.
> the empirical track record of "LLMs can't..." is in itself a reason to call it into doubt ... Every "can't" of this nature was followed by a discovery of "they can, just poorly", and then etc
replyWhat LLMs are "fundamentally incapable" of doing has striking parallels to https://en.wikipedia.org/wiki/God_of_the_gaps