I like that. Might some of that logic have made it to consumer word processing programs?
replyThat's uhh...a language model?
replyIt's a modeling of language, it's not structurally anything like an LLM.
replyIt’s literally a trigram (character) language model. Check any NLP book from before 2015 or so.
replyLLMs have more stuff bolted onto them (embeddings, RLHF) but the autoregressive core is a direct descendent of that sort of language model.