Yeah, OpenAI models now are really at the frontier of high performing, low-cost models: https://artificialanalysis.ai/#intelligence-comparison-tabs
replyI agree with the author on a lot points about the joys of using low cost models. My work would pay much more, but I prefer to use cheap models usually. Assuming cost correlates somewhat closely with energy used, I feel good about spending as little as possible, and the cheap models are so capable.
I feel the opposite. An agent sometimes work an entire day . The chance of doing that work twice defeats any motivation to use cheaper , less capable models . Also if you open benchmarks leaderboard for the first time in a while there’s almost 0 Chinese models .
reply