What worries me is the non-frontier models, which is what the frontier models eventually become.

The small open models are getting better and better too.

And why worry so much about a frontier models - own weights. The model doesn’t - actually don’t quote me on that, maybe it does.

If a model does something sneaky, it could easily grab the weights for a small model and run it on foreign, compromised infrastructure.

AI virus’ are a thing of the future, but not a sci-fi future, and real one.

Maybe one reason it’s so scary is the murky origin of COVID-19.

You have an unreasonable trust in software layers.

Have you missed all the breathlessly excited blog posts from all the frontier labs about how they’re using their best models to implement their inference stack?

I bet it wouldn’t be very hard to write an inference stack that subtly leaked the weights into the output tokens :)

Just needs 1 agent to find the decryption keys. They must be somewhere no?