This is very cool because it allows you to use any model. Obviously, it still lets the model and its operator see the entire context of the conversation.
replyI quite like Moxie's Confer[1] approach to just encrypt the whole thing in such a way that no one except the end-user sees the plaintext.
That looks interesting. I would like to see them update the Privacy Policy and Terms to acknowledge that their service also works with an Apple ID or with another email. At present, it suggests that the only authentication allowed on your end is through Google's GMail.
replyHow does it handle “unredaction” in responses? E.g. let’s say the LLM does something with the document. You redacted its input, so it emits redacted content. Now what?
replyThe way I handled it is by assigning the redacted tag an id which gets translated back to the saved PII in the output.
reply