upvote
I'd say that's the second-best one. The most robust ZDR policy is running your own AI locally and enforcing the retention policy yourself.
reply
Yes that's why Revolut (Europe's largest digital bank) has just started self hosting open weight models using 56 Nvidia B200 GPUs. So their 2000 engineers will use that for most things.

Expect many more companies to follow.

reply
That’s not true. They switched for cost and productivity reasons.

They explicitly specified USA, EU, UK, and Israel-hosted services as acceptable as long as it’s ZDR. They said that inference hosted in China was something they didn’t want.

The talk is here: https://www.youtube.com/live/akEqiXFo3GM

reply
deleted
reply
This right here.

ZDR is a marketing ploy. It’s not real. Only naive people believe it’s real.

reply
I generally trust (for example) bedrock to honor the ZDR agreement as written and to have secure infrastructure. However I don't fully trust the routing service I use to access bedrock to have rigorous security practices.
reply
deleted
reply
> Ultimately you’re in the same position of having to “trust” that they’re doing ZDR

Could it be a moat to offer a zero-trust (based on technical impossibility) ZDR solution for corporate customers, or is everyone who’s paranoid enough about that just going to host local models on-prem eventually?

reply
Not an expert, I consult with medium size firms that so far have seen nice things from the AI. However, the lightly-informed C-Suite hears about the hacks and the data threats on CNBC/Bloomberg which has made them cautious. Even with their cursory understanding they are saying "can we look at these open models". N=2
reply
Isn't that the problem themselves, in that those issues only exist if you go for open models, but outsource inference to third parties? It seems to me that there are only two safe options: either go full local and do inference on-prem/in your own cloud, or just deal with the big labs directly. Everything between these two extremes involves third parties with sketchy reputations.
reply
I think there's definitely a market, on prem feels expensive and intimidating for many no matter what it actually costs or takes
reply
"On prem" here just means renting a server with a GPU. (Possibly "in the cloud".)
reply
So even more expensive.
reply
Multiple companies are already advertising TEE-based private inference.
reply
> Nice to see this move by OR.

Unfortunately, I highly disagree. I'm deeply disappointed that they don't even have the gall to call the violators out so we can be informed. Dug around for so long and I can't still find all the rule-breaking providers. It's a bunch of "trust us bro" nonsense. Name and shame should be the minimum here.

reply
If they are going to name and shame they have to put in a lot more work first to be sure their evidence is tight enough to dissuade or dismiss defamation lawsuits, and there would still be risk and lots of drama for people too busy for that shit. It just isn't realistic to expect that in my opinion.

Its possible to be very certain of the evidence you have but not be able to prove its not been tampered with or fabricated, for example.

reply
deleted
reply
what move? OpenRouter is garbage, how could Stripe have thought it was a good idea to buy them? $7b for revenues that will evaporate, inevitably, all at once, in weeks!
reply