upvote
Apparently it’s going to take the 3 of us to do this, mate. Going to get so much reading done.
reply
What you get is not what you cost.

40% overhead is quite typical, so you'd be looking at $120k/year. In the USA I'd consider that a competitive salary for an admin capable or keeping a $6M rack of specialized hardware running 24/7.

reply
Yeah but you don't need two such people, or even one, dedicated to this single rack.

A company of the size that this is worthwhile for, probably has dedicated devops on staff already and can add this rack to the inventory with no additional staff.

reply
Who is going to upgrade the models ?

Who is going to fix it when the api does something weird ?

Who is going to proactively make sure it’s not overheating?

Chat GPT has enterprise contracts for a reason.

reply
The same person managing the company's email accounts and whatnot.

I didn't say it's fire-and-forget. I'm saying all that is maybe a day of work every 3 months.

reply
My company is not even the same ballpark, but even we already have people for it. And doesn't include the fact that you can get a colo location and just a MSP or a contractor to do it for you
reply
All of the answers to your questions above are in gp's comment already:

> A company of the size that this is worthwhile for, probably has dedicated devops on staff already

reply
deleted
reply