- monitoring server error rates
- reviewing security footage
- watching plant growth / controlling watering
etc. Any long running task you can now just slap a PS5 on it. 70 cents a day in power cost means you now get ~2M output tokens per day (~$3.50 worth of usage). It's not the worst thing in the world if you have one lying around. 2bit isn't even that terrible - it's ~80% the accuracy of 27b at full quant, which should put it at around GPT-5 levels of intelligence (which honestly is crazy in its own right).
I'm sure someone will point out some spec that's better on the PS5, but the extra $200 will make up the difference if you spend more time looking than the 15 seconds I just did.
(or if you just build a PC from parts yourself)
Those projects should default to hosts less geared toward corporate governancy; custom internet domain being the first requirement.
I struggle to think of anywhere on the entire open internet you could put something like this where it could not be taken down.
And at that price point or a little bit more you might as well just get an RTX 3060 and save yourself a lot of hassle (you also get DLSS, DLAA etc.)
The readme oversells it by pretending it would be something actually usable, when instead it is a cool achievement to make it happen.
https://www.ncsa.illinois.edu/2003/05/27/playing-the-superco...
However you can run comparable or better models than gpt4. Try to stay under 30b