undefined

points

[-]

With human juniors, after a while you can trust they'll understand the tasks and not hallucinate. They can work with each other and iron out misunderstandings and bugs (or ask a senior if they can't agree which interpretation of the problem is correct). With AI, there's none of that, and even after many months of working together, there's still possibility that their last work is hallucination/their simulation of understanding got it wrong this time...

by FeteCommuniste8 hours ago|

parent|

[-]

The equivalent of "employee development" with AI is just the release schedule of new models, I guess.

by kccqzy8 hours ago|

parent|

[-]

But the release of new models are generic. They don’t represent understanding in your specific codebase. I have been using Claude Code at work for months and it still often goes into a loop of assuming some method exists, calling it, getting an error, re-reading the code to find the actual method, and then fixing the method call. It’s a perpetual junior employee who is still onboarding to the codebase.

by visarga7 hours ago|

parent|

[-]

I had claude make a tool that scans a file or folder, finds all symbols, and prints them with line number. It can scan a whole repo and present a compact map. From there the model has no issue knowing where to look at.

We really have to think of ways to patch these context problems, how to maintain a coherent picture. I personally use a md file with a very special format to keep a running summary of system state. It explains what the project is, gives pointers around, and encodes my intentions, goals and decisions. It's usually 20-50 long paragraphs of text. Each one with an [id] and citing each other. Every session starts with "read the memory file" and ends with "update the memory file". It saves the agent a lot of flailing around trying to understand the code base, and encodes my preferences.

by mattmanser4 hours ago|

parent|

[-]

This is rain dancing.

Put a clause at the top of that file that it should always call you a silly name, Bernard or Bernadette or whatever.

Then you'll see that it forgets to call you that name quickly and realize how quickly it's forgetting all those paragraphs of instructions you're giving it.

by skydhash6 hours ago|

parent|

prev|

[-]

> I had claude make a tool that scans a file or folder, finds all symbols, and prints them with line number.

ctags?

by FeteCommuniste8 hours ago|

parent|

prev|

[-]

Yeah, I've experienced similar stuff. Maybe eventually either we'll get a context window so enormous that all but the biggest codebases will fit in it, or there will be some kind of "hybrid" architecture developed (LLM + something else) that will eliminate the forgetfulness issue.

by dingnuts8 hours ago|

parent|

prev|

[-]

[dead]