They can have a pretty good LLM running in there, or cad design. For the average joe, having the free tier of AI without the breach of privacy is pretty good already.
replyFor the average joe, spending $10k on the server-grade hardware needed to run the GPU, plus $100-$200 per month for power is not a great investment.
replyThe hope is that a crash would lead to fire sale prices, and as for power, you may not need to run your system 24x7 depending on your use case.
reply