A few days ago we got the news that DeepSeek makes 38 dollars profit per card with their off peak pricing (in the inference server release discussion).
replyIf that is true, either the American labs are not optimizing correctly or they make a ton of money with inference.
DeepSeek designs models that require less hardware resources for inference.
reply