> They don't turn off people's access
replyThey do. I often get the message "This model is currently experiencing high demand, please try again later"
> They don't turn off people's access...
replyThey do drop requests though? At peak times I sometimes have 1-2 requests fail with Opus; no biggie, the harness just retries it. But that, in aggregate, sheds load.
deleted
replyYou serve the requests more slowly. Same as if your bank has a sudden rush of customers - the tellers serve them in order, and the customers wait longer. Some of the customers 'time out' (get frustrated and leave).
reply> You serve the requests more slowly.
replyThats not what Openai and Anthropic do though
Really? I have noticed times where the model simply doesn't start 'spending' tokens for a considerable period, using their official harnesses.
replyI guess there's an alternate universe where that happens
replyI must have found a wormhole into this universe and fallen through without realizing, because I've used Claude Code and gotten "This model is currently experiencing high demand, please try again later" as an error message.
replyI'm not denying model nerfing. I'm asserting an opinion about the nature of the nerfing.
replyIf you want to go accuse someone of denying model nerfing, go find someone doing it and argue with them.