I've found it present wrong, skewed, biased, or old information. In other cases, it seems to ignore the elephant in the room. I find all of these things problematic when trying to learn something new. The less I know about a subject, the more susceptible I am to being mislead.
replyWhen I bring these things up, it will apologize, tell me I'm right, and adjust. But what if I didn't know enough to question it? Approaching from the other angle, maybe I'm actually wrong and it's a sycophant, as mentioned, trying to please the user?
On the topics where I'm having to correct it, I probably shouldn't bother asking in the first place. On topics where I'm not correcting it, is it because the AI was right, or I just don't know enough to call it out? This kind of thing worries me about AI being leaned on more and more as a teacher.
Never rely on the trained data. I always ask to do a research which means, it pulls fresh data from the web. Another thing I enforce all the time is simply "don't make assumptions, give evidence" - that basically means it has to prove from where it takes it's statements. I do pretty fine like that.
reply