upvote
I probably shouldn't say this, but I work at a company related to CPU manufacturing.

Part of my job is to ensure that HPC programs (largely LLM libraries these days) work on their next-generation CPUs and with new BIOS revisions. We test them using a shared pool of machines with various configurations. GPU machines are much scarcer, and we have to share them with other teams, so it's hard to reserve a time slot. I usually reserve a CPU machine around the clock so I can work whenever I want (I'm more productive at midnight), and nobody seems to mind.

I've worked here for almost a year now, and I love my company ;)

reply
reply
“related”
reply
deleted
reply
480 core xeon kinda hinted at that :D
reply
Thanks for sharing!
reply
Hmm, an unnamed CPU manufacturer using a ton of a specifically named processor. No idea where you could be working, I’m stumped. ;)

Well I guess you did say ‘related to’ manufacturing which widens it a little. :P

reply
That's a fun machine but there's similar (or even bigger) configs on AWS - https://aws.amazon.com/ec2/instance-types/u7i/

Expensive, but you can just try things!

reply
Roughly what would the above cost?
reply
u7i-6tb.112xlarge

$62.79/hr

https://aws.amazon.com/ec2/pricing/on-demand/

I run many high core jobs for various reasons, I often reach for many smaller machines rather than one enormous node like this. But not familiar with how lean parallelizes.

reply
Jane str
reply
Any company which self hosts in a data center has employees accessing to hardware. Every company I've worked at was on-prem. Why is this treated as an outlier? Is everyone on AWS these days?
reply
No need to be snarky... having access to HPC clusters has little to do with "on-prem VS cloud" and is certainly an outlier in the prevalent SaaS world.
reply
Not snark, I was just surprised. No need to be cynical. If we are talking about HPC clusters specifically, then of course I agree.
reply