upvote
Until about 6 years ago I also mostly used ex-server "ewaste" hardware, because it's always been cheaper, except for electricity use which I wasn't paying for myself. My desktop in ~2015 was built from 2006-era hardware, with 32GB of ECC DDR2, which felt like a lot at the time.

My "6 years ago" build was with more typical current-gen consumer-grade hardware, because at that point I was on the hook for the electricity bill. I haven't thought about what my next build will look like because it's still going strong (aside from a flakey DIMM... so my next system will have ECC).

reply
My homeserver is essentially a top of line gaming PC from 2012 with a Quadro RTX 4000 from 2018. It was not top of the line in 2013 when I bought everything on sale but after many inexpensive ebay upgrades, it's now what I wish I could have afforded back then. Most of the time, it's perfectly fine since it's main job is jellyfin. I'm sure I could be saving some electricity with newer hardware but with the current market, it's just not worth it. I'm missing AVX2 support which Claude Code has recently made a requirement but now I just have Claude ssh into it from another PC that is a few years newer.
reply
I've been extremely pleased with my R320 in a NAS role. Idles at 40 watts, is quiet, has ECC, and the drives stay cool.

Maybe that's still too much power for some people, but I'm happy with the tradeoffs.

reply
I have 2 Huananzhi EPYC boards.

At about $350 each, I had to try them. Everything else was double.

Only thing I can say so far is, they boot linux on second hand EPYC 7002 series CPU's.

Haven't put them through their paces yet. V

Oh, I remember quirk #1 ... apparently, only 1 of the case fan headers is speed controllable, the others run at full speed all the time, with no bios setting.

You can fix it with a fan hub that supports pwm so not a show stopper by any means, for those wanting to try these motherboards.

reply
What's up with the "V"? I've seen a couple of your comments that have a lone V at the end of the comment or paragraph.
reply
I end up with B sometimes because I use iPhone double-space to get a period and accidentally triple space but I miss the third and hit B. Maybe V is the same.
reply
Awesome! Technology to the rescue. Glad it's not just me.
reply
peace V

I guess its a substitute for "just so you know" or "fyi" or any other "I'm an authority on something" ending. :D

reply
About six years ago (as a holdover until I went full homelab, which I never did) I built a machine with some spare parts, a $40 Xeon E5-2650v2 (8 core Ivy Bridge), and one of those Machinist motherboards.

Initially it was just for home server stuff (ZFS array for storage/backups, Plex, Vaultwarden, etc) but then I wanted to experiment with a remote dev environment using LXC/LXD.

I now do all my web development (mostly back-end, Python and C#) on that machine via tmux and VS Code remote SSH. I'm sure if I was running my browser on it it might painful given the slow single-core performance, but honestly I've felt zero need to upgrade it. Once the RAM-pocalypse is over I'll probably look at doing so just for reliability's sake.

reply
I have one of these Machinist boards sitting in my closet, which I haven’t set up mostly out of laziness. What I really want is a PCI-E card that can take DDR3 RAM to be used as a RAM disk for containers that do a heavy amount of heavy I/O.
reply
One or two DDR3 ramdisk cards were produced but they’re basically non-existent today. There are DDR4/5 ones (CXL), but they they’re restricted to specific enterprise motherboards.
reply
I imagine those countries have sane energy prices compared to Western Europe.
reply
Regardless if the market allows consumers access to negative solar prices or not, consumers can attach solar panels to their servers (independent of the grid), so the LLM is there when the sun is shining.
reply
> when the sun is shining.

So no LLMs for 3-5 months a year in most of Europe?

reply
personally I think we should look at 12 km tall floating balloons piping a suitable vapor at ground temperature up, dumps the heat a bit above the tropopauze, condenses the vapor so it rains back down (perhaps in a loop, perhaps as a naive thermosiphon).

I believe we can generate baseload energy by cooling the planet... nearly everywhere, no fuels needed.

reply
Energy is a commodity so the price will be very similar for the same goods. What they tack on as taxes might be different.
reply
Energy means electricity in this case, and the EU prices are about 2-3x those paid in China AFAIK, for both residential and commercial.
reply
EU is big and prices vary. (Transfer capacity is limited)

Afaik electricity is around 7c/kWh in China. I got 8c/kWh 2y contract a couple weeks ago here in Finland. Though have to add 4c/kWh for transfer to that (no clue if the Chinese prices I could find include that). Commercial prices are less then that (no VAT and possibly lower power tax bracket. The 8c includes all taxes/fees)

reply
The cheapest price in Europe at best equaling the average price in China sounds like it just proves my point?
reply
No. You're comparing apples and oranges.
reply
Electricity cannot be shipped from one place to another in bulk quantities.
reply
And data can be.

Which is why I suspect most nominal "data centers" are fronts for crypto mining, an activity that seeks out the cheapest energy.

reply
You're thinking the whole AI boom is just a front for crypto mining?
reply
Me too.

EU average is just under 29c/kWh (non-contract price) [0]

In the UK I got 27.5c/kWh (+ 58c/day fixed charge) on an 18-month contract a month ago

[0] https://ec.europa.eu/eurostat/statistics-explained/index.php...

reply
That is expensive. If it makes you feel better, U.S. utilities' published kWh rates don't include a whole bunch of other things that make bills much higher than you'd imagine. For example, I used 280 kWh last month for my apartment, at a nominal rate of either 11 or 13 c/kWh (the rate changed from 13 to 11 partway through the month as it got cooler).

But after all the "sales true ups" and "affordability charges" and "resource adjustments" and "fuel cost charges" and "interim rate adjustments", not to mention the city fees and sales tax, the final bill divided by my usage gave me an effective rate of 23 c/kWh.

reply
That sounds horrible, even in Europe deceptive and abusive tactics towards taking people's money are a constant hazard. I can't imagine trying to exist without even what little protection we have.
reply
Utilities are actually highly regulated in the US. Those rates and fees are publicly available and explained when you get your service, for what it’s worth.

Utilities have to argue for rate increases and get them approved by regulators, so they’re not just dropping fees on top of everything as they please from month to month.

Really nobody should assume that their service is flat rate with a slope down to $0/month if you consume 0kWh. There are fixed and marginal costs in every service like this.

reply
> Utilities have to argue for rate increases and get them approved by regulators, so they’re not just dropping fees on top of everything as they please from month to month.

Do regulators ever reject rate increases that the utilities ask for?

reply
There is a state utility regulator that is supposed to ensure this stuff is fair, and it is disclosed ahead of time. Regardless, for small energy users like me, the fixed costs and extra fees are a huge percentage of the total. Thankfully the total electricity bill is not terribly consequential for my household budget.
reply
My thought was that the EU average can't be that high, but apparently Finland is just the outlier here.
reply
I think in Quebec they've been paying me to use power.
reply
Good for you
reply
The E5-2670v1 was goated for this back in 2016-2017. You could get them for like 25-50 bucks. I still have one of the supermicro boards I got from work in hardware decommissioning and one of the chinese franken-boards with a modded bios.
reply
Yeah, I have an old X99 old asrock Fatality (lol) board, micro ATX with a Xeon E5 2640 and 128GB of ECC DDR4 running 24/7 as a Truenas server with 80TB of storage in it. It seemed like an overkill when I put it together two years ago when I replaced my 5820 CPU that had been my daily desktop but now with storage and everything prices exploding it has turned into a very useful thing. I still don't like the fact that it sits at around 130 watts. But given that it has so many hard drives in it, it's not that bad. My whole basement cloud now feeds into it.
reply
I just bought a Xeon E5-2690 v4 for $16 and a Sparkle A770 for like $350. Going to try some local models on there. I think it will be plenty good for my use cases.
reply
Typing this from an Asus X99 WS 3.1 with a E5-2696v4 . I got 256GB of RAM, sees only 128GB but I am sure with some overvoltage and lowering the ram speed it could see all 256GB.

if anybody got a tip, i'd be more than glad to listen, please.

reply
Thanks for this! Your post inspired me to look at my X99-UD4 system that was put in a closet some years ago. The board currently has a 5960x CPU, and I did not know I could put an E5-2697v4 CPUs in it. I have a couple of these v4 CPUs and tons of DDR4 modules from a recent data center decomm event. Time to hack again - it may revive my old PC!
reply
> Typing this from an Asus X99 WS 3.1 with a E5-2696v4.

Yeah the Xeon E5 v4 to me are really an amazing spot. These things, today, are basically free. If you look a bit you can buy stuff like four 20 cores E5 v4 for $60, making them effectively $15 each. Basically free.

And here's the trick: I don't need my Xeon to be up 24/7. 8/7 is sufficient, so I save 2/3rd of the electricity cost. I set up my network so that when I sleep, my main server doesn't need to be on. The services that really need be on 24/7 (say my DNS for when I'm sleeping and my wife/kid need Internet) are running on a Raspberry Pi (which consumes nothing).

And when I need the shitloads of cores / ZFS etc.: I turn the Xeon on.

Now it's still a server in my case: my main machine is a recent AMD.

> if anybody got a tip, i'd be more than glad to listen, please.

Slap 128 GB of the 256 in a $50 used Xeon server and use that has a backup / to run VMs / ZFS / etc.

reply
There are significant performance/energy ratio problems with older hardware, particularly with the rise of ARM.
reply
It's fun to think about running datacenter hardware at home, until you get the electricity bill.
reply