For sure yeah! What I’m pointing out is that I see people mistaking LLMs for “truth engines”, when they’re not. I find the “autocomplete” mental model really useful for when I work with LLMs myself. E.g., always keep in mind what’s in context, what’s not, where to get context.
replyGoes without saying - humans are no truth engines either lol.
Yes, "predictors" or "completers" are a far more accurate metal model for what they actually do and it pays to understand how they "use tools" and what RL, SFT, etc. is and how it makes LLMs seem like much more than what they still, ultimately, are.
replyPeople latched onto the bs marketing terms like "thinking" way too easily. I don't know where all the classic hacker skepticism and desire to know how things actually work went the past four years.