Gemini estimated that male cannabis plant leaves I decarboxylated will have negligible thc content and give me mild relaxation at best, the real effect was it was the highest I've ever been.
replyThat is in the training data. Confidently and correctly answering in-distribution questions (possiibly with a tool call) is expected by now.
replyAren't you missing OP's point entirely? Which is: If the LLM didn't have useful information it would still give you an answer... Helpful or not.
replyNot really, since any LLM will answer all those questions competently.
It's a known fact that LLMs sometimes are wrong and hallucinates an answer, but this is exceedingly rare.
Having access to a decent LLM is like having an expert with me. Are they always right? No, but the analogy with a two year old simply doesn't hold up.
reply> Since any LLM will answer all those questions competently
replyThat's false. The LLM will only answer competently if it was trained on that data; and if it has enough data to make the correct connections between your question and the "correct" answer.
In the case of this article they're specifically saying the LLM has limited training.