That's max output tokens per response limit, separate from context length
replyIt's the output token limit, which has been 128,000 for Claude models for quite a while note
replyPretty crazy that the model doesn't know that it needs to stop before it hits 128k output tokens. I guess it has no sense of how many tokens in it is? Wouldn't this be possible to work into the architecture?
replyI think this is a bug. I've not seen this problem from any of the other frontier models.
replyI would also consider this a bug. I think ajy reasonable consumer would.
replyDo other models put a hard cap on the output tokens it can generate?
replyYes, the OpenAI GPT-6 Astra limit is 128,000 as well: https://developers.openai.com/api/docs/models/gpt-6-astra
replyGemini 3.8 Flash is 65,536 https://ai.google.dev/gemini-api/docs/models/gemini-3.8-flas...
deleted
reply