I think it is inevitable that more capable models will require export controls, KYC, background checks, verification of credentials, etc. Even if you don’t buy Anthropic’s marketing of their current models, there is a future where models are capable of developing chemical weapons, biological weapons, cyber weapons, etc. which are genuine security threats governments will care about controlling and preventing. Maybe this prevents big commercial labs from developing more capable models until they figure out appropriate safeguards, but this is a good thing, a world where you can ask an LLM for an airborne rabies genome and it will simply produce it for you is not a world we should want to live in.
Yes governments can, and probably should, restrict some things completely to all those outside of official government institutions but once something is public in one country it is effectively, even if not legally, public in all countries.
But for "physical" things like biological, chemical or nuclear weapons the know how / information part, that AI can "help" with is far from the complete picture. Articles have already been published on how to make a nuclear bomb. The knowledge isn't really the blocker that's more access to the required materiels and equipment. However in the cyber space then yes AI could indeed give the "bad guys" much more capability.
But they didn't say that. They said "only US citizens". Once something is available to hundreds of millions of people there will be leaks like it or not. Some accidental and some voluntary.
And even if it could be done it wouldn't solve the purported security issue anyway. Does anyone believe there are no criminals or terrorists with US nationality?
Except for xAI/Grok. Government officials in charge have deep connections there and will never apply such rules to them.