Every hyperscaler hosting these models outside of FEDRAMP environments has been compromised by every regional power’s intelligence services. Fable was running all over the world until today.
replyAWS and friends are very good at providing excellent enterprise grade security, but it’s literal child’s play for nation state threat actors to exfil these models.
TEMPEST / EMSEC alone is a wide open door for unclassified datacenters when the Mossad’s out to get you.
I'm skeptical that you're going to be able to reliably exfiltrate ~10TB of model weights using TEMPEST. Which is not to say weights are secure, just that this isn't the threat model I would be concerned about.
reply