upvote
Seems that V4.1 Flash is quite cheap to serve. Especially how it implements the cache, meaning the cache pricing can be very low depending on how you implement it in your inference engine.

Depends on your use case. But if you do software development with a harness such as oh-my-pi, your cache rates are probably somewhere above 98%. Coralbricks has free cache reads, meaning it's much cheaper than the Deepseek API rates.

Lithosai is more expensive especially in the ultra tier. It's if you want extremely snappy and fast responses, which is important e.g. for a personal assistant where every second counts.

If you generate a lot of output, you're better off with the Deepseek API rates.

reply
Ive never needed an assistant pre or post ai to reply to me in 100ms at a clip of 500 words per sec. See you in 15 min, Im making some cofeee.
reply
same here, but surely the trends will follow every other profit-seeking web app ever and distill down to a competition over attention.
reply