To elaborate, I can ask each model to write a doc about something I know well and tell you which output I like better.
replyBut to assess whether my preference on my problem is going to generalize across other people, other programming languages, other documentation types/formats, etc., and then analyze statistical significance is a thornier question that I don't have the data to answer. I'd rather make no recommendation than a weakly informed recommendation.
I use Astra 6 Extra High for everything.
replyIt’s overkill most of the time, but frankly all these models are “cheap”, and I’d rather waste compute than brain cycles trying to discern which dials are best for each individual as-hoc query.
But Astra is simply bad at writing. I have to use Argon to rewrite everything Astra wrote in an academic setting. Astra always tries to cover every small detail and engages in defensive writing that is unreadable.
replyHow are they cheap? Does your organization offer unlimited spend, or does your subscription not run into the same limits as mine?
replyMaybe if you have subsidized 200/500 dollars subscription it may look that way.
replyTotally agree. I'm working a lot faster when being just about everything I want on the first hop, without model switching and goofing around to find the sweet spot. When I need a janky answer I run a model locally with llama.cpp
reply[flagged]
reply