Do any products exist which are not built on uncompensated work of other people in the past?
Generally speaking societies do better when knowledge is shared and not hoarded.
Hoarding knowledge via legal constructs is great at concentrating wealth to the hoarder at the expense of everyone else.
We should restore copyright to its original term lengths.
I agree with the stance of Anthropic et al that these models should be built with all possible information.
I agree with the stance of the FSF that the resulting models should be as freely usable/available as possible.
These companies do even better because we're not allowed to share the knowledge (read, illegally copy protected works) and they are.