It's a great post. Or as Scott Alexander put it at the time:

> A machine learning researcher writes me in response to yesterday’s post, saying:

>> I still think GPT-2 is a brute-force statistical pattern matcher which blends up the internet and gives you back a slightly unappetizing slurry of it when asked.

> I resisted the urge to answer “Yeah, well, your mom is a brute-force statistical pattern matcher which blends up the internet and gives you back a slightly unappetizing slurry of it when asked.”

> But I think it would have been true.

https://slatestarcodex.com/2019/02/19/gpt-2-as-step-toward-g...