upvote

points

by Aurornis2 hours ago |
comments
upvoteby brailsafe2 hours ago|
next
[-]
Reasonable analysis, especially because this person seems to have an actual house. In my case, I rent and don't pay for electricity directly, so the cost effectiveness threshold is whenever the landlord starts complaining
reply
upvoteby twsted2 hours ago|
prev|
next
[-]
I think, may be actually wrong, that most of us do not consider running a model locally a way to save money. It is a way not to spread personal info around.
reply
upvoteby Aurornis2 hours ago|
parent|
[-]
Anyone running LLMs at home will come to that realization quickly, if they’re looking at their power bills. Even feeling the heat output of a computer running at 100% in your office makes it clear.

I was responding to a lot of the comments saying this was a reasonable way to avoid paying for tokens or subscriptions. I don’t want anyone getting the wrong idea that this is a way to save money if that’s their priority.

reply
upvoteby euio7571 hours ago|
parent|
[-]
> Even feeling the heat output of a computer running at 100% in your office makes it clear.

What does it make clear? That I can replace the space heater my wife runs 9 out of 12 months of the year with a home server? And effectively get $0.00 per token during those times?

In houses running A/C year round, sure there'd be some impact, but in all the places running heat, doesn't seem that it'd move the needle on power bills.

There are startups whose entire business model is "cloud server as a home space heater" (aka "data furnace") ...

reply
upvoteby Aurornis37 minutes ago|
parent|
[-]
> What does it make clear?

That it’s pulling a lot of watts.

Good for you if it’s replacing electric space heaters.

reply
upvoteby bitexploder1 hours ago|
prev|
[-]
It gets better in the cooler months when heating is running in a home :)
reply