> they don't have "memory", they have no capacity to learn outside of the training stage

The underlying LLMs don't, but the agent frameworks around them do.