The target audience is who needs raw speed.
replyHaving the choice is good as you can make a trade-off between speed, perf, and quality.
Until last year, people had a single AI god they believed in (mostly Anthropic stuff). Now we have power to make choices (open-weights, SOTA, speed-optimized, etc) the same way you do for system designs.
It's not a criticism, I was really looking forward to trying out such a powerful model at this speed.
replyBut I burn my 5$ allowance in 10 minutes ... and only because I was hitting rate limits, without it would probably be less than a minute.
I hear ya... the best option is to use company budget as normies will rack up ridciulous amount soon with that raw speed.
reply