> You serve the requests more slowly.
replyThats not what Openai and Anthropic do though
Really? I have noticed times where the model simply doesn't start 'spending' tokens for a considerable period, using their official harnesses.
replyI guess there's an alternate universe where that happens
replyI must have found a wormhole into this universe and fallen through without realizing, because I've used Claude Code and gotten "This model is currently experiencing high demand, please try again later" as an error message.
reply