> ~1000 bytes per context token per user
replyWhere's that figure comning from? Last time I checked (could be the 3.6 Qwen 27b) single token needed 32kb
The smallest I have seen is DeepSeek 4.1 flash at 890 bytes per token.
replyWhere's that figure comning from? Last time I checked (could be the 3.6 Qwen 27b) single token needed 32kb