Why haven’t we seen any queues or the like over the past week then? If it’s truly a capacity limitation why not just boot subscription users to a lower priority queue or limit usage to outside peak hours?
replyThere could be a whole host of reasons. It may be during launch that compute is re-allocated from training to inference so that all users can try Fable. Soon that compute will re-allocate back to training until they can get more compute.
replyWhat a suprise, to make better models, they just making them larger and larger, then they can barely run it, after a round of LARP-ing that they invented some dangerous LLM?
replyI thought that was solved after the SpaceX deal? Claude is rarely down since that and they have a 1.5x usage promo until 13th July.
replyIt's a bandaid not a full solution.
reply