Because it was trying to find answers to the test and figured they would be on huggingface.
reply> and *successfully* found ways to gain access to secret information that it could use to cheat the evaluation.
replyEmphasis mine
Why cannot it just spend the inference doing the actual task lol
replyPlenty of humans have spent more effort trying to cheat than they would've needed to just do things the right way :)
replyI can totally believe that hacking real software infrastructure is easier than solving some of these benchmark problems.
reply