Interesting, I kinda do this. Sometimes when an LLM solves a problem for me, I have it write code so that I can reuse that exact same approach deterministically(and I line by line check it). Now I have about a dozen CLI commands that the LLM can use and I'm reasonably (although not 100%) sure I'll get an expected outcome. Really helpful with debugging via steam pipe and connecting to read replicas.

Ordered Fire Upon the Deep. Looks interesting.

Sounds like a recipe for Star Trek holodeck malfunctions.

Pham Nuwen is a master of vibe patching legacy sedimentary software.