Having worked in the space, 6kVA is the norm from 10-15 years ago, 12kVA is the standard for regular compute workloads. With HPC/AI all bets are off though.

No, your expectations are not wrong. I'm a small business. A fully stacked AI/GPU cabinet is multiples of this. A single GH200 based server will have 2x2.7 kW power supplies in a 1U form factor. As you can imagine, I am not running a cabinet full of such servers. But you don't need AI power requirements to do normal software. And there's lots of normal software to do!

That’s standard practice in many data centers; but you can often pay more to get more amps delivered to your rack.