upvote
There are real exceptions to this rule, like Tinfoil.sh who cryptographically ensure they cannot retain the data. (As long as one trusts the chipmaker, I suppose.)

Of course, even with a privacy-respecting inference provider, if a modern, relentlessly proactive LLM runs in a harness with internet access, it can easily accidentally exfiltrate your data anyway.

reply
> As long as one trusts the chipmaker

Rather you have to trust the equipment operator (which in this era of clouds isn't necessarily the vendor) not to intentionally compromise their own hardware (see https://tee.fail/). But other than that quibble yeah, tinfoil looks like an excellent option that's much less likely to leak than current alternatives.

reply
It seems great
reply
read anthropics tos. it says very specifically that they do not train on "inputs" and "outputs" of customer data. everything in-between is openly declared to be their legal right to train on. in terms of their ability to extract intelligence from inference there is zero difference between this and training on "inputs" and "outputs."
reply
By the definition of how these companies see data, a simple transform to restructure the input and output would be sufficiently different to pass this bar.
reply
exactly. the tokenization is not the input.
reply
That’s why I never use a real email or real name.

The payment is where you have to provide real infos.

I just hope the payment infos is stored at a different place than prompt/conversations storage so mapping of user id to payment id is not trivial.

reply
The payment is where you have to provide real infos.

What? I've never provided real world info when paying.

I always use Monero when paying for AI tokens. Crazy to do anything else.

reply
More insane to use cloud provider AI. Do you care about security or privacy at all? I run my own models. Crazy to do anything else.
reply
How do you prevent the model from exfiltrating data? Are you running it in a harness with no internet access or doing something more sophisticated?
reply
deleted
reply
Don't give it internet access.
reply
Which inference providers lets you pay with Monero?
reply
Mistral are bound by EU law
reply
All citizens are bound by law but this doesn't mean you will have 100% confidence while walking in a dark alley at 3AM in a city you don't know.
reply
North Koreans that could hack Mistral and sell data for crypto are not.
reply
I fully expect them to be storing it, just the period of time they are storing it for is up for debate. Even everything older than six months ago, at this stage for me would be pure junk. If you want to train on that when I was still using soul files and barely any harness, heh, well that's your problem now!
reply
I think tinfoil provides that(if CPU manufacturer can be trusted)
reply