The obvious question of “is a square a rectangle?” is definitely NOT causing any LLM to say “no”.
Hallucinations are an issue but they genuinely are no longer a concern for any modern non-tiny LLM for basic facts that you would expect a K-6 course to cover. Maybe you might be able to find a few random hallucinations in knowledge covered at the high school level but I’m quite skeptical even that still happens. Yes, they can still, at times, hallucinate sources but I cannot recall the last time I actually saw this happen. I think it was at least a year ago
I don't understand how your wife interrogated the AI to be told a square is not a rectangle.
And how can two tutors disagree on this?
With the amount of blatantly false information I've seen LLMs spew out in response to my very simple questions, I can very easily imagine one would get this basic information wrong somehow, although I did just Google it (as Gemini, and particularly the on-search-result-page version of it, seem to be the absolute worst of the common models in my experience), and it did get the answer right.