You could train an LLM on a dataset that intentionally excludes certain data, and see if it is able to extrapolate outside of its dataset and come up with those excluded items independently.
replyFor example, remove all code from your training data, and then see if the model can code regardless.
Thanks for the elaboration. (Though I'm not sure
dmarinus would agree with your criterion?)
reply> For example, remove all code from your training data, and then see if the model can code regardless.
Would you accept this weaker version: make up a new programming language (that's guaranteed not to be in the training set), and see if the model (which has trained on programming in existing languages) can cope?