The non-commodity network services of the early 1990’s and the non-commodity 3d graphics hardware of the mid-1990s made the same argument.

I think this will be isolated to highly specialized fields where training data will need to be selectively curated.

Everything can be distilled, it will just become more painful