upvote
The system prompt is always loaded in its entirety IIUC. It's technically possible to modify it during a conversation but that would invalidate the prefill cache for the big model providers.
reply
What you're describing is not how these things usually work. And all I did was a wc on the .md file.
reply