That could effectively be the case here but your statement in isolation is an oversimplification of recent legal guidance on this matter -- AI generated things are copyrightable if there is sufficient human authorship involved in the generation process.
replyThe copyright office's recent statement on this matter were sensationalized when they really said nothing groundbreaking at all -- this was always the standard applied when any tools are used in creating a work.
Even if the weights are just made through traditional training and no AI is used to make the weights... is there a copyright right? If the weights are a numerical derivation that aren't made by a human is there even human expression? Absent human expression, there is no copyright right?
replyThe output being created by a machine is not automatically disqualifying. e.g. PCM audio data is all created by a machine, but that doesn't prevent CDs from being copyrighted... because the input to it was highly human-created.
replyUltimately it all hinges on the specifics of the training and how much human involvement was involved throughout the creation process. I suspect arguing this successfully in favor of upholding a copyright would be an uphill battle for many situations, but ultimately we'll need more court cases to know for sure.