upvote
>DeepSeek from 3rd parties goes for like $0.036 in

Lmao no it doesn't. That is the cheapest price and from a single random provider.

Sure, go ahead and use them. Maybe they're serving you a decent quant. Maybe they're even serving you the real model.

The absolute cheapest provider I'd ever touch is DeepInfra (they have plenty of problems) and they are $0.09 for input.

reply
Yeah that is right, that was the lowest not average! Even at that $0.10 is very reasonable! Tbh the quant wouldn't be an issue if openrouter didn't default you to spread across different providers, makes it hard to get consistent results for evals.
reply
These cheaper ones are usually limited on context window or token speed or latency or heavily quantised.
reply
Click on the provider, scroll down and you'll see effective prices. Both DeepInfra and DeepSeek are at $0.008/M input. DS Flash is unbelievably cache efficient.
reply
[dead]
reply