How did the early Roman Empire interact with Greek city states?
How are LLMs planning on learning new information on the fly without new context or retraining runs?
Why did mom leave?
You know, standard stuff.
Even as a human being who has a working brain and all this thinking power, I am not sure how I would answer that. It's kind of funny Gemini will still come up with something and even suggest follow-ons to the conversation but saying all that stuff as a human to another human would be a wild response to that question.
Reinforcement learning by human feedback.
It tells me there's a Costco 10km from me and I'm like, yeah let's go there, that's the one I meant! And then it sends me to one that's like 40 minutes from me all across town and I'm like WTF?!
Never mind asking Android Auto any question that's not driving related. It just doesn't understand me at all. Or even some driving related ones. "Find Alternative route". "Sorry, I can't help you with that". WTF?