Fireworks "datasets" are used for batch inference as well as training models. Notion mentioned that the leak was due to some feature they have to classify previous ai conversations. They probably uploaded these conversations as a 'dataset' to fireworks in order to take advantage of their large batch processing discount.
replyCan you really trust an AI company to be actually ZDR though
replyNot unless you can verify it through secure hardware attestation like with Apple’s private cloud compute system
replyEven with that, you can't really prove or provide evidence they aren't silently slinging the data elsewhere during transport anyway. Unless you're doing Homomorphic encryption, it all seems to be for show.
replyThere's also the nvidia enclave stuff. If you trust their hardware, then you can also trust its cryptographic proof that the data was not seen by the inference provider.
replyIgnoring whether or not there could be backdoors, security holes in the Trusted Execution Environment stuff are still being found on a regular cadence.
I'd guess it's good enough to avoid bulk surveillance (and therefore extraction of training data, which I guess is the attack that Notion was running when they screwed up and leaked the data), but that's about it.
Apple's stuff is a similar story. (And so are VM enclaves, which have been around longer.)
you can stop after the word "Not"
reply