upvote
> If you are that reliant on LLMs for your workflow, then how do you not have any redundancy in place?

You could ask that question about the MS outage as well and million other things.

I suppose I can't understand because where I work our scale is small enough that we can have an actually resilient infrastructure and can stay in control of almost everything we need, and when you get bigger it's more difficult? I mean, even an outage from our email provider could be worked around in a matter of a couple hours at most.

I'm really not sure it's not just because most managers are clueless and shortsighted though.

reply
> we can have an actually resilient infrastructure and can stay in control of almost everything we need, and when you get bigger it's more difficult?

It's a culture thing, if it leans "engineering-heavy", you usually have contingencies, tests restoring backups and lots of other "goodies" that gets skipped if you don't lean that way. Microsoft and similar organizations been a sales-and-enterprise leaning organization for most of its life, so of course they're not gonna think about what happens when their "always online cloud tooling" goes offline when setting things up, it's much more important to finish things quickly and have a long list of features to be able to present to customers.

reply
There are already entire companies out there without a single human who has any idea how their systems are implemented, let alone being able to manually fix them. This problem will only worsen with time.
reply
Depending on company size and security posture (like mine), we only have one provider claude and the company outright bans all other ones, even local models unless approved via a lengthy process
reply
> Depending on company size and security posture (like mine), we only have one provider claude and the company outright bans all other ones

I get it, we had to sign separate HIPAA BAAs with Anthropic and OpenAI - but we did sign them both, if only to be able to have access to a wider array of models.

reply
Unless these were meetings about how they would enable redundancy soon with the help of $llm
reply