Interesting. LLMs seem to now handle other kinds of state changes with ease, so I'm not sure why they would trip over this.

Do you mean stack-based source code languages like Forth or PostScript, or directly writing machine instructions for a stack-based ISA/VM like the JVM?