But you can't run the locally at full quality. And quantized versions you can run locally are a far cry from Opus 4.6.
replyAnthropic serves quantized versions of their models and you can run q8 locally.
replyI don't even use Sonnet anymore. Current feels worse than Claude 3.5 couple years ago. They have quantized that much? Switched to GPT 5.5, let's see how long it will stay good.
reply