Try llm-consortium with --judging-method rank
replyI think it will make results way better and more representative of model abilities..
replyIt would... but the test is inherently silly, so I'm still not sure if it's worth me investing that extra effort in it.
reply