I think OpenAI and Anthropic have both been doing similar "routing" approaches for a while. Wasn't OpenAI one of the first to have a small model start responding to you for the first several tokens so that you got an instant response while the big model became available?
replySimilarly, Grok has been routing to Opus internally for a little while now I think.
> undisclosed new approach from Anthropic
replyAny source on that?
There’s a METR audit document which apparently describes various unreleased models. This is discussed in a YT video by Wes Roth. I have no firsthand knowledge about it.
replythey do have the 'advisor' model setting now which also plays well with this
reply