I think for this purpose a small model will do reasonably well
replyWhat's weird is I didn't see mention of accuracy in the article.
replyNot really. Haiku is really not good at decision tasks (source: real experience).
replyRight. So we can either assume the engineers at Amazon are fucking clowns who don't do any engineering, or we can assume they tested and found that Sonnet was the cheapest model that met their reliability targets.
replyIf you think the former is a likely hypothesis, then why did you even click on TFA?
Anthropic was the only frontier lab on bedrock for a while. Hate to break it to you but there are in fact many scenarios with reasons and pressures for non engineering-driven decisions to dominate
replyLet's keep the discussion civil
replyThat's rather extreme? There is an possibility than Amazon's engineers are neither infallible nor idiots. Regardless of this specific situation highly talented engineers very often take decisions that lead to suboptimal outcomes on organizational level due to various reasons.
replyOne can think the circumstances a circus without thinking the participants all to be clowns.
replyAs for your question, seeing what others are doing helps one decide both what to do and what not to do.