"I've found Claude is one of the worst models with regards to pop culture knowledge like this, "
replyIs that bad?
I want to use models for coding and reasoning capabilities, not pop trivia knowledge they can get with web search.
For most cases probably not. It's just something I like testing new models on sometimes, the pelican riding a bicycle benchmark probably isn't that useful either.
replyBut that is just testing for encoded knowledge, the pelican riding requires some reasoning capabilities, but lost its surely usefullness a while ago.
reply