Well I am fully of the opinion that LLMs can help in software programming, it's not something that I feel provides any value unless it has a human in the loop. The overhead of having to figure out if the agent did a good job, if the agent is actually done or not, and if the thing it built is shit or not, is worth simply avoiding by having a human in the loop.

So I wouldn't agree that the agent should be cranking out code all the time, in fact that seems more like a waste of resources compared to the work it creates. But I do understand home automation software can be very one-off and simple. But then again, a properly programmed home automation suite doesn't need a SOTA model to modify it, I think.

On all projects I've run any of the models they:

- infinitely duplicate any and all code, helpers and components

- infinitely duplicate CSS (because they duplicate components)

- continuously write code like "read the entire db into memory and run a filter function on retrieved data"

- continuously write code like "call db with multiple queries for each element in a list"

- etc. etc.

Why the hell would I ever want to run them unsupervised?