I bet they do that as well but I also think that if they have to choose between inference speed or "intelligence" they would choose the latter.
replyThey don't have to choose, though, since they can release multiple models with different tradeoffs.
replyThis would imply they have infinite development capacity
replyNot infinite, just enough to make more than one model. OpenAI and Anthropic both have four different size categories...
reply