upvote
> The words "it's a miracle it works at all" routinely popped up in those conversations, which is... something you don't want to hear about any sort of power generation - especially not nuclear - but it's true.

Funny thing is, those are the exact words I use when talking to people about networking. And realistically anytime I dig deep into the underlying details of any big enough system I walk away with that impression. At scale, I think any system is less “controlled and planned precision” and more “harnessed chaos with a lot of resiliency to the unpredictability of that chaos”

reply
This is one of the key insights in my early SRE career that changed how I viewed software engineering at scale.

Components aren’t reliable. The whole thing might be duct tape and popsicle sticks. But the trick for SRE work is to create stability from unreliable components by isolating and routing around failures.

It’s part of what made chaos engineering so effective. From randomly slowing down disk/network speed to unplugging server racks to making entire datacenters go dark - you intentionally introduce all sorts of crazy failure modes to intentionally break things and make sure the system remains metastable.

reply
Message on a mug: "if carpenters built houses the way programmers write software, a woodpecker could destroy civilization."

The syncronasation of a power grid ... Wow.

reply
> those are the exact words I use when talking to people about networking

Or the U.S. financial system. Or civilization in general.

reply
It ultimately comes down to shared norms, shared expectations, and trust.
reply
Which is why the long tail impact of current times is frankly terrifying.
reply
If people knew how crappy, insecure, and unreliable nuclear computer systems were, there'd be a lot more existential dread about cyber security
reply
Almost all computers are insecure, not just the systems in nuclear stations.

Most operating systems are based on ambient authority, which is just a disaster waiting to happen.

reply