upvote
When you are writing completely new prompt - it sends every character to server when writing and tries to make suggestions based on that.

And keeps doing it in intervals in /prepare endpoint, during each prompt.

So if you are working with something sensitive - don't write it to browser directly and edit it there.

reply
But then why does it become dog slow when the chat becomes bigger?
reply