upvote
~20% for Harvey's Legal Benchmark doesn't seem saturated.
reply
I don't think new benchmarks are saturated. They still give you a clue, they arn't perect but they have value. If model can't even do some easy tasks from benchmark then why would u even consider using it?
reply
With these numbers, I'm holding my breath for the pelicanbench.
reply