upvote
For a mechanic, that's a practical distinction. For most people, it isn't.
reply
I don’t see people driving engines around, since that is impossible. You actually need the rest of the car around the engine to have it function as a drivable vehicle.

It is a pretty practical distinction.

reply
Of course. But most people don't buy an engine, ever. They don't have one laying around. They buy a whole car, every time.

So, since apparently I may need to clarify my actual point: For most people, an LLM-plus-agent-harness is just "LLM" or "AI". If you're trying to build one, you care about the distinction. Ditto if you're a pedant. But most people are not either of those things.

reply
the most widely used API surfaces are already shaped around chat, it's different and most analogies will fall short in some way
reply
Neither a chat or an API are an LLM.
reply
By that standard Gebru was also not writing about LLMs in the Stochastic Parrot paper.
reply
LLM's have chat templates that sit at the lowest levels of how we feed tokens to them. It's quite integral to how they are trained to process tokens and rises up through the tech stack.

Go to a huggingface repo, look at the files, they have a literal chat_template.jinja

reply