upvote
It isn’t the concern of the LLM. Regardless of where the encryption/decryption is happening, the issue is that the LLM needs to access the raw CoT.
reply
Again I don’t think you’re really getting at what I am asking. Sorry. My whole point was why does the LLM have access of decrypting. It should happen outside of the LLM layer.
reply
LLM does not work on encrypted tokens. It happens at the API gateway.
reply
Wild this would get downvoted. I am asking a question, the bots must have come in.
reply