upvote
It's mostly R&D though, not inference. If LLM's effectively become a commodity then they are screwed anyway.
reply
Aren’t the Chinese labs quickly turning them into a commodity?

The open-weight models will have a steady race to the bottom on inference costs just by dint of competition between providers. They aren’t at the frontier yet, but they are rapidly eating the flash market.

reply