It's still very expensive compared to using the hosted models which are currently massively subsidised. Have to wonder what the fair market price for these hosted models will be after the free money dries up.
replyInference is profitable. Maybe we hit a limit and we don't need as many expensive training runs in the future.
replyInference APIs are probably profitable, but I doubt the $20-$100 monthly plans are.
replyFor sure Claude Code isn’t profitable
replyWhat speed are you getting at that level of hardware though?
reply