upvote
First look what models are worse in a set of self selected benchmarks.

Second, compare to older versions of competitor s models.

Still does not look good? Compare to own previous models.

reply
Not much moat, incremental improvements, cherry picking models to compare.

To be fair, seems more correct to compare against similar strength models if your main edge is pricing.

reply
Anyone deep in the AI realm know which is the gold standard benchmark for coding?
reply
They're being called "trust me bro benchmarks" for a reason ( ・ั ﹏ ・ั )
reply
Wait to the exact moment your model is ahead on at least N benchmarks then publish.
reply