I disagree. A program/repository is not a big chunk of text. It's more like logic to perform a particular function represented in text which is a symbol of language.

"To think that reducing entropy/complexity in a system is some inherently human capability is both anthropo-centric and full of hubris."

Humans invented LLMs and Agents etc, designed, programmed, etc. etc. Seems they are more an extension of humans -- tools that rely on humans.

An LLM/Agent left to it's self on a code base does cause entropy. I've only ever seen them not cause entropy on the first prompt.