In my experience the input field lags on short chats too, sometimes in the middle of writing the second or third prompt. Are they running some kind of prospective evaluation or something?
replyWhen you are writing completely new prompt - it sends every character to server when writing and tries to make suggestions based on that.
replyAnd keeps doing it in intervals in /prepare endpoint, during each prompt.
So if you are working with something sensitive - don't write it to browser directly and edit it there.
But then why does it become dog slow when the chat becomes bigger?
reply