upvote
They are selling it, not running it.

It is just a dedicated computer system, which should be managed by its owner, like any other on-prem servers.

I doubt that it has a good price/performance ratio, but it is a solution for those who feel that they do not want to search, buy, assemble, install and configure every HW/SW component.

reply
I take it we saw different demos.

I'm under no NDA, if you actually want to know what's up.

reply
I'm assuming you're alluding to them selling a managed solution, alongside the unmanaged solution that the GP is referring to?
reply
I want to know, please tell us
reply
deleted
reply
Ohhh spooky vaguepost.
reply
For those that don't mind a lot of rootkit and embedded spyware you mean
reply
Fair but the idea of "running your LLM setup" at every "need" level and corresponding cost does make sense.

For a lot of people (and orgs I'd guess) who just go and buy ≈$20 per month plans (or more for teams), they might not even need a fraction of that cost or capability. A lot of them don't even need it for coding or graphics. Even the API access based pricing aren't great from these frontier US AI houses. The distribution of "LLM being" offered will also give rise to many open-router like offering but at the end point level - direct interfaces to the customers. Pick your vendor sort.

AI shouldn't become another "search means Google".

reply