upvote
I think where both camps get hung up is sometimes the process method group "ignores" the obvious outcomes and effectiveness of LLMs.

But the outcomes group "ignores" the fundamental limitations of models which are purely text based.

E.g, a baseball players trains to catch high-speed balls and they dont do it by: "ball velocity 50mph, vector:[1,2,3], run move hand command now"

That's absurd.

No, there is an embodied network which is "trained" on visual, tactile input, and control as direct output.

LLMs are fundamentally not the right tool for that.

reply
> E.g, a baseball players trains to catch high-speed balls and they dont do it by: "ball velocity 50mph, vector:[1,2,3], run move hand command now"

That is a NN that learns a skill.

But that is not an Analyst. If it were ballistics, then the answer to "how to parametrize the launch to reliably hit the target" excludes getting the result through natural skill.

The problem lies in the need to get "AI" facing "LLMs": the latter create a need for reliability, for "AI".

Speech is an endowment of both those who give educated guesses via developed skills and of those who return answers like Analysts, who check and compute. LLMs create a confusion between the two, and they will remain a problem until an ability to act as Analysts - strictly - will be implemented.

reply
> These models aren’t thinking.

They are for any definition of the word that makes any kind of sense. I'm sure you have a contorted definition that magically only includes humans though...

reply
> for any definition of the word

For "thinking" here we mean "assessing a representation of an object". That, or equivalent, is required to be reliable. So it is fundamental and critical.

reply
Sure? If humans happen to be doing something that LLMs are not, then should the answer change to accommodate your disdain?

The models are simulating thinking, if the fidelity is good enough for you - great!

reply
It depends on whether you assume that thinking requires doing everything that humans do. I think it would be silly to say that an AI doesn't think because it doesn't wrinkle its forehead in concentration. So you need to decide which parts of the way that humans think are actually necessary components of the process.
reply
Tbh it doesn't even matter if humans turn out to have a soul, or quantum microtubules or whatever other magic LLMs can't have.

The normal definition of the word "thinking" definitely includes what LLMs do. Hell people used to say computers were thinking even before AI. It's super weird to get all uppity about the semantics of the word now.

reply