Right, having products so poorly described that a customer needs to run their own evals to choose well is exactly what is being complained about.
replydeleted
replyOr I'm going to give up and not use any. Consumers aren't perfectly rational. This isn't like toothpaste, where, despite being overwhelmed at the store, I still need to brush my teeth so ahhhhhh fuckit and just pick a toothpaste out of the 30 available. The alternative is I keep using Google search and think AI is stupid. Or just use Facebook's thing.
replyThe frontier toothpaste is the one with bioglass 45S5. Especially if you have sensitive teeth or your teeth are prone to caries.
replyNano-HAp is good, too
reply> > But does Terra 6.1 beat Sol 6?
reply> Run your own evals then if you have this much of a need to "correctly" choose.
No. OpenAI want my money, it's on them to communicate properly.
What would you want to see instead? Not sure about you but my needs are specific enough that I don't think OAI has evals for them, and I wouldn't want to give them that data even if they wanted to run it for me.
reply“ChatGPT 6.1 Max” would be simple.
replyThen you're going to have ChatGPT 6.1 Max Low and ChatGPT 6.1 Max Max.
replyHow does one more-properly articulate "it depends"?
replyOn what?
reply