upvote
I'm hopeful that Tinfoil's enclave router, which does decrypt the payload but does so in a verifiably secure manner, can be used to scale to multi-gpu models (for example, Tinfoil does offer Kimi K3.1 Pro).

Because of economies of scale with batch inference as seen with DS4.1 Flash, this is the only avenue for true privacy from frontier models at scale/cost.

In terms of policy, I agree it's looking dire. There's unfortunately just more money/lobbying/mindshare on the 'safety at all costs' camp but I'm still advocating and educating where I can.

reply
We will however need hardware elements that are actually secure. The current generation is trivial for the operator to compromise. https://tee.fail/
reply