upvote
My Mac Studio uses about 60–80 watts whenever I’m running a model (as measured by the system metrics), so it’s less than 2 kWh/day at full blast. Electricity is like 0.125 €/kWh, so that 24-hour period would be <0.25 €.

Not accounting hardware in my costs, since I didn’t buy my hardware for running models. Running models is just something it can do in addition to what I got it for.

reply
The price, processed tokens, and output can be anything, it just depends on what GPU it is.

Nvidia GPUs are much more efficient than Apple hardware for inference(and training).

reply