You would lose caching (if they cache)
replyOr just buy a 5060. This will run on most any 16gb card. Slower for sure but far cheaper than another subscription.
replyOr buy a raspberry pi with a SSD, about the same difference, if you're giving up on the 1500 tokens/s anyways.
replyThats not the point if you choose Cerebras as provider.
reply