You can't really compare API prices though. The cards that they are running frontier models on in the datacenter can service hundreds of simultaneous requests and are at nearly 100% utilization. This thing would sit on your desk and be used to service a single user for a couple hours per day.
replyIt is the locally ran models that get me excited. They have an immutable user agreement and a focus on privacy.
replySubscription / on-demand polices are a moving target, along with cost.
I foresee the ML market replicating the video streaming services market. Join us at a low rate and no advertisements. Six months latter, advertisements for everyone, unless you pay more $$. Now $$ will still show you ads. We are raising the rate to $$$ with adds ...
The main subsidy, from OpenAI, is ending 10/26. It’s still “cheap” for now compared to all the other non-open weight frontier models, but it won’t last since OpenAI’s stated goal is to make it so that there’s no much of a difference price wise between on demand API calls and subscriptions
reply