upvote
We don't need LLMs that can "answer any question on any topic in a library"!

We don't even need machines that can answer any question in a specific topic area. But we could use machines that can answer "I don't know." when they cannot compute the answer.

Consider the possibility of much-smaller LLMs that answer questions only in limited domains (physics, chemistry, math, medicine, etc.)?

Could not such LLMs exist? If not, why not? Would they not likely be more useful and far, far easier and cheaper to create and run (possibly even with far less hardware) than the current "know-all" LLMs? Also might they possibly avoid certain problems ( e.g., hallucinations, deceit, apparently undesirable behavior, etc.) associated with the "know-all" LLMs we now have?

reply
[flagged]
reply
We need to up the ante, we all know it's the Mumbai Indians. ;)

One can train a decent model at home, for a specific task but you are absolutely correct that in order to have a model that's an expert in any topic it requires training and data on all topics.

reply
I nearly spit out coffee reading this. Amazing use of vocabulary; especially "... oh great spirit of the internet".

I sometimes jokingly explain to certain people not immersed in tech that sometimes saying the "magic words" (commands) from the "codex" (script) in the right sequence with a lot of hand waving allow "magic" (applications/web apps/etc.) to happen.

It generally brightens a patients day and makes things relatable to those non-technical, children, the elderly, or the like.

TLDR: thanks for the chuckle.

reply