> say predicting missing words in Wikipedia articles, which you can't do successfully without a good understanding of English

This is word2vec model, one of - predict a word from context. The other one is to predict surrounding words (context) from a word. It did a good job when I used it, words' classes were impeccable for most practical purposes.

Word2vec is a two layer perceptron.

¿Por qué no los dos? Big skill issue, you can even route known problems to a trained in-house simple classifier and low-confidence problems to Jev-like "zero shot classifiers" or LLMs.

I feel like people in the field forgot everything.