There's the other (orthogonal) possible explanation of using more GPUs for stress-testing before product launch.
replyThat's less an orthogonal explanation and more an example of why they'd do something like serve a quantized model.
replyNope, they deliberately enshittify the old model right before release to fake the metrics.
replyGood ol' sawtooth step change.
reply