6 Mac Studios for 100k USD.
Consider it a rule of thumb now - 100k to run 1T params, scales linearly.
replyOut of curiosity, what do you do to distribute the weights and inference across the multiple machines?
replyThunderbolt 5, and software
replyat a 100k$ you're not buying apple products to be limited by the 120gb/s thunderbolt port.
replyIf you have 100k you can just buy a few b200s.
replyI don't know that "consumer hardware" is a useful distinction anymore, it's just "what's your budget and what's your speed requirement".
replyConsumer hardware means:
reply- 120v input plug
- not rack-mounted
- has a video out port
To me, "consumer item" is when i don't have to contact sale people for price.
replyAh, a MacBook Professional is Consumer /s
replyIn computing "Pro" is not the opposite of "Consumer".
replyPutting aside the fact it is a marketing label, "Pro" usually means "designed for work" while "Consumer" (in this context) means "doesn't need a special environment".
In computing the distinction is primarily noise, power and cooling requirements.
If a computer is designed to use home power and is quiet enough to use without annoying people and doesn't require specialist cooling then it is a consumer device, even if it is used for work.
Apple's use of "Professional" is just a fancy alias for high end or premium, it in no way indicates anything about being "for professionals" (most extreme example: "professional" iPhone models)
replyHence why they had to make up the "Studio" brand for the workstation market, because they'd already fully removed any meaning from "Professional"
Yes?
replydeleted
reply