I never said offloading was impossible. It will result in a large slowdown.
replyIt would look bad for cerebras if other people are hosting the 27b version and show a higher TPS than cerebras.
It would look bad for cerebras if other people are hosting the 27b version and show a higher TPS than cerebras.