upvote
And I use SOTA models that are hosted on hardware I don't have access to a handful of times a month at this point, and most of the people I talk to regarding LLM usage are either in the same boat, or are asking about hosting things themselves. The diminishing returns for using the best of the best models just aren't worth it for most things anymore.
reply
Extrapolate
reply