It's still very early days. There are many benchmarks that LLMs scored 36% on just 18 months ago that they're now at 100% on.
replyWhere did you get this perf metric? I couldn't find it in the release
replySecond chart (it's to the right of the first chart and clicking it to scroll is easier than otherwise)
replyWow screw lightbulb is lower than tie bag or close ziploc. Pretty surprising.
reply