The implication would be that GPT-4.5 was not judged to be human 27% of the time. You can't determine how often humans were judged correctly as humans from that data point.
replyThe structure of the test was that there was one human and one AI conversation partner, and the rater had to choose which one was which.
replyGiven that structure, you can judge from that data point.
That was also before the crazy AI hysteria we have today with the em-dash police everywhere.
replyFor the test to be free of bias, we’ll have to ensure all the humans are from Nigeria.
replyThose stats dont necessarily line up that way. Do you have a link?
replyGiven the way the test was structured it does line up.
replySurprisingly good. I wonder how they would have done without the 5 minute limit on conversations (average of 8 messages per convo per the study)
reply