I made a VCS for LLM assisted work, bootstrapping it on its own code as it was developed. In fact, if it did not really work, it would not even exist! In my experience, keeping track of things and evaluating them was the bottleneck and I focused on that https://replicated.live/blog/worktree Effectively, the question is "how to leverage human evaluation and feedback".
The Cursor people concluded their last post with "taste, judgement, and direction came from humans". Sounded surprisingly sane after "don't compile it, commit it faster" some paragraphs earlier.
The issue with AI is it has no real memory, context, long term reasoning, etc. These are a lot of what we use to determine how well we're doing something as well as why.
The "bottleneck" so to speak with ai is that it will just circularly build junk forever, expand scope infinitely, and just continue building.
At its best it will autobuild your unicorn saas. But on average it's a cancer cluster of ever expanding code with no plan.
The issue with unsupervised AI is that when you increase the throughput you decrease the amount of human supervision. So you have to have some way to deal with that.
If I'm going to give AI a gigantic task that's really complicated and it will probably mess it up 100s of times, how will I compensate for that without constantly looking over it's shoulder?
Some critical parts of agentic development are literally months old while most mature ones are merely a couple years old.
Critical thinking was the most critical checkpoint for models to reach.
Now its only a matter of time for the right tooling and orchestration to come along. Once agent memory and recall works well, all of those bottlenecks will go away one by one.
I feel like the whole concept of harness and LLMs IS to pick random tokens which make sense. Think about this as a solution space (a very complex one), then the harness and the LLM are moving towards the local minima at which the code is complete. This is akin to how we think about AI anyways.
It’s rare to run into prodigious artists who simply produce a few perfect pieces - as a rule those few magnum opuses are built on a hill of cutting room floor scraps.
If you already know what you want in an infinite library, it is there. If you don't know exactly what you're looking for to the letter, you might not be able to find it.
tijebs gi yo,
But I’m glad someone else is running all these experiments so we can see who is right in their guess about the outcome.
Monkeys have been reading Shakespeare all their lives (training). Effectively, this is LLM uncompression. Hence, "in Rust, from nothing but its documentation" -- not entirely true.
Douglas Adams said this beautifully in the Campaign for Real Time & the poet Lallalfa.
And I just found out h2g2.com is no longer online, so no reference.