upvote
It isn't about storing the data you send/receive. It is about having a model live through millions, or billions, of tokens doing the job. The current state becomes very important. Especially when you think about how interacting with these things works. No system prompts, just keep working with it until it is good at its job and then using that state as a starting point for other jobs. picking a bunch of different states as starting points, etc etc. You didn't use a simple system prompt to get there, you used interaction and examples and just like a person you decided they were good enough at some point and let them start doing the job for real. It is a totally different system than current models use.
reply