I've found this fairly accurate: https://huggingface.co/spaces/multimodalart/jev-decision-ind...
replyThat's good but I would definitely appreciate one with cost to run the benchmark and cost vs accuracy breakdowns.
replyArtificial Analysis has an Index which also includes Cost per Task, Time per Task, accuracy, calibration etc. here: https://artificialanalysis.ai/evaluations/artificial-analysi...
reply(caveat, I work at AA and helped build this Index)
just found this today and used it as one of the links I sent a coworker who hadn't heard of decision models yet!
reply