(apnews.com)
- Physical branches closed or unresponsive.
- Online banking down.
This exact same thing happened in Europe with Revolut late last month. It was resolved in about 12 hours: https://www.revolut.com/blog/post/20octoutagetechnicalovervi...
In that case, it was a Google Cloud outage. Something similar (database outage) could be the culprit here.
> “JPMorgan Chase has experienced a temporary issue related to a software bug in an on-premise hardware system — it is not cyber-related,” said Joe Evangelisti, spokesman for the bank.
Eh, actually, I don't know if that's true about 2nd rate programmers, in a lot of ways they're probably better, but they do get paid less.
I realized this while working at a startup. The startup had a webpage that worked half the time--that's it, that's why we had funding. Well, that and the founder was going around telling investors we had fancy AI algorithms, which were actually mostly manual human work.
Meanwhile my friend working at the bank made a lot less.
“JPMorgan Chase has experienced a temporary issue related to a software bug in on-premise hardware systems,” the bank said in a statement
https://www.nytimes.com/2026/11/16/us/bank-outages-down.html
- Cards working
- Branches (the few we have left) open, or at least it was when I drove by at lunch
- Online banking has been working for me all day.
In a hurricane, the dollar keeps it's value, as others outside of the affected region are still using it to trade. This may not be true in the event of a national/global outage....not to mention the whole 'trust in the USD' aspect
Things like food, water, basic sanitary items, would be bartered for.
No doubt there have been some crimes and things done in desperation, but humans don't just instantly devolve into roving gangs that kill on sight.
You'd still not want to be a lone wolf type with a gun, though, you really want to have a group in all cases.
People, collectively, come together. There's always outliers -- we call them assholes. It's nice that some folks are so clear on what side of line they intend to stand ahead of time -- pay attention to what your neighbors are saying, so you know which ones are the assholes.
Basically, these guys: https://www.nytimes.com/2025/11/22/us/texas-men-haiti-island...
Anyone known to be a prepper is a really great target in an apocalypse. One-stop shopping and typically doesn't work well with others!
All hat, no cattle.
.223, while we're on the subject, is used in the AR-15.
If we were to judge people by the guns they carry, I would rank ar-15 carriers the least worrisome. They would be far less likely to be a decent shot on average, they are the least likely to know anything about actual firearm tactics and try some hollywood or COD:MW run and gun, and will likely be the first ones shot when they decide some 70 year old farmer or hunter is an easy target who suddenly blasts them from a dark window or tree stand.
-Deng Xiaoping (paraphrased)
There are definitely issues with that, but it does work in the sense that people can buy and sell things and survive, provided the government is competent enough to provide good quality notes and coins and resists the temptation to print too many.
After all it’s how western societies worked throughout human history until relatively recently
Yeah, I'll just get out my pocket knife and carve a little chunk off that big bar of gold when I'm trying to barter for gas at the truck stop. That'll work.
Doesn't help if the world truly goes to shit and doesn't recover for decades, but if there is any kind of recovery then the gold would be worth something again.
On the other hand stablecoins such as USDC can be sent over the internet on blockchains such as Tempo, Solana, XRP and Stellar worldwide, 24/7 in less than 5 mins and with extremely low fees.
To Downvoters: Come on. You cannot send your physical paper dollar notes to someone else in another state or around the world in less than 5 seconds.
I'd be annoyed if I was a BOA or Chase customer too. But the truth is that blockchains such as Tempo continue to work anyway worldwide 24/7 without fail.
The U.S. government is very interested in keeping the banking system going and will throw all available resources at doing so.
?
But did you know that your bank would get knocked down offline?
There's no need to get upset about that.
> The U.S. government is very interested in keeping the banking system going and will throw all available resources at doing so.
Good. They can coexist.
The next time your bank goes back online, you can wait days to send your money around the world, while those using blockchains like Tempo (yes, Stripe built that) are sending money in milliseconds all around the world with very little fees at all.
Roman citizen wondering why the aqueduct isn’t working kind of thing.
Also undervalued by society as a whole and politicians especially.
They'd rather allocate funding for a new bridge they can point at and say "I did that" than properly fund the unsexy work of making sure the existing bridges are maintained.
Now apply that across most western democracies, repeat for decades and we are where we are.
The countries doing their vast infrastructure build outs will likely repeat the pattern in a few decades.
When banks started moving to computerized systems, maybe a bank would be unable to process something... but not multiple banks. I can't recall any "outages" that affected banks nationwide for any period of time. Walk into your local bank and find out they can't do something because their big system at the mothership is down? Perhaps.
Consolidation likely plays a part in this as well. I can't speak to the FAA/ATC systems 50 years ago, I have no recollection of what they were like then, but the only nationwide system I can think of around that era was Ma Bell. And I don't honestly recall any nationwide outages back then. Regional, sure. You might have a problem with part of the country getting calls if there was some kind of emergency... (e.g., everybody trying to call their grandmas in Kansas after reports of a tornado) but I don't remember there being any nation-wide problems like that.
We had to count on actual snow for snowdays. :-)
There was this one in 1990 [1], but it's notable because the system was otherwise very reliable. Also, this report says only 50% of call attempts failed, presumably most people would try their call a few times and likely get through.
[1] https://users.csc.calpoly.edu/~jdalbey/SWE/Papers/att_collap...
In 2006, Amazon had just launched this new storage service called "S3." It would have struck people in 2006 as bizarre to think that AWS (and Cloudflare, and GCP, and friends) would one day be so crucial to the internet that a bug there could take down dozens or hundreds of companies.
Every service except digital lending/materials continued to function, and there were fallback processes for recording everything that happened so the information could be added back into the digital system once the tech was fixed/power was restored. Specifically designed forms that were easy to use and easy to scan, an exact understanding of what needed to be recorded and why and where it would go later, etc. And a staff of people who were meticulous enough to actually follow through.
When I hear people talk about "we can't do big things anymore" in the US, they are usually referring to mid 20th century stuff a la https://patrickcollison.com/fast, not stuff that we did 10 years ago.
I do not believe the FAA has ever grounded the entire country due to a network upgrade going bad. So that is possibly an example of a hard thing we could do a decade ago, that we can't do now.
Not the things that are breaking, no. The FAA was doing ATC a decade ago. We had email and cloud servers a decade ago. We had bank websites a decade ago. The scale of those things today is perhaps larger than a decade ago, but not enormously larger; indeed, the increase in scale in those things is much smaller than the increase in computing power in the world from a decade ago. So these things should have gotten more reliable--but they haven't.
we made these systems simpler to maintain, to reduce the amount of skill we need to pay for to maintain them. And that does reduce the maintenance costs, at the cost of more compute. but who cares about compute costs where compute per unit of money doubles every 18 months, amirite?
unfortunately it also increases the competence required to change these systems without degrading their performance and usability.
since no one wants to pay that extra cost either, we let the systems degrade a little bit at every change instead, hoping they degrade slower than hardware improves.
that bet was bound to lose eventually, because of laws of physics, and because that degradation pattern affects hardware too.
and the double whammy is - with little demand for expertise - the supply is effectively gone too. so now that the walls have closed in, there is no way out.
[1]https://www.fintechfutures.com/baas/bt-fault-hits-uk-banks-d...
[2]https://abcnews.com/US/hackers-block-us-banks-online-service...
If I were you (or was working at somewhere with an outage), even if it wasn't AI, I would still be blaming AI. Because the alternative means you shouldn't have a job in tech.
I was able to log into my bank's website in the late 90s, FWIW. Yet today I can't seem to do that.
But for everything else you need, food water shelter healthcare, you need to submit to europay visa mastercard
They are entirely wrong.
None of these outages, as far as we know, have a common cause. They just happened by coincidence inside the same news cycle.
Nor is there any evidence to blame them on AI, or tech layoffs, or hackers from Iran. It's more likely something boring and technical that doesn't fit into anyone's narrative.
Not sure. Personally yesterday I investigated a reflection attack that was bringing an entire network down, the ip originated from both china and iran. The colleague that brought me in there was paniced, he spent 25 years as a msp, but that kind of attack was a first to him. My oss project has seen 20 security reports last week alone, mostly reporting the same things over and over again, and everything form coming from my website is being hammered by spammers in that I've seen a 100x increase in spam over the last few weeks.
1. Does there seem to be a larger concentration of outages recently? (I would say yes.)
2. Is there actually a larger concentration of outages recently, or does it only seem that way because of an increased focus on this? (I would say that there is really a larger concentration, but I'm less certain about this.)
3. If there is actually a larger concentration of outages recently, is that because of AI? (This is the point at which I become pretty unsure either way.)
4. If it is because of AI, how exactly is AI causing this? (I think more widespread vulnerability discovery / exploitation is more likely than "everyone is vibecoding everything now and that's screwing everything up", but I'm not entirely sure.)
5. Is this just transitional growing pains, or is this a new normal, or is this the beginning phase of a pattern that is only going to accelerate? (I don't know the answer to this one at all! I hope it's the first thing, but I wish I were more confident.)
Either way, now that AI is more capable, you can really mess stuff up at scale.
You saying they *are* entirely wrong is as baseless as their claim. Sure, you can say they don't have a common cause, and I agree with that, but chances of these events with different causes occurring so close together is very low and the chances of a same root cause is probably more plausible.
One way or another, they've tried to avoid addressing tech debt, avoid hiring and retaining good people, and have more or less been kicking the can down the road / running on the edge without knowing it.
Or else they did embrace AI-driven "move fast and break things" approaches, and so they broke things.
They flip-flop between maximizing profits and draining operational divisions of any resources, and hoping to sprinkle a bunch of IBM magic pixie dust all over their infrastructure to solve all their problems without needing to understand any of it. You rarely find one that strives to understand problems deeply and invests in long-term planning and maintenance before a crisis hits.
The result is old systems that eventually break, system upgrades that go bad because nobody understands them, security holes that someone might have hacked into, etc. All the same basic root cause at the top, which is that most of our leadership class is full of incompetent short-sighted narcissists. And it "works" because most of the time it pumps the stock due to lower costs, and we only see the fraction of times that it causes headline-grabbing catastrophes. On a long enough timeline, though, they'll happily drive our entire society off a cliff--and we're getting closer and closer to that (at least politically).
It's your job to provide evidence they are related, and you have nothing except speculation.
It’s actually hilarious that you made the irrefutable claim, and then you are telling me to find proof.
They'd really be the only people with information about the cause of the issue; if they blame an AI-generated code change or the actions of an AI agent, that would be good evidence.
There are many more systems in the world outside of it, even if it is relatively ubiquitous at this point.
"As far as we know" just indicates a lack of data, not evidence that they're not related. This is especially relevant for a political administration whose response to COVID was to bury their head in the sand by hiding data. Also: A public comment of "AI is hacking all our shit" wouldn't exactly calm the public.
It's fine to say, "I'll wait until we know more", but in the meantime AI progress continues and the sheer volume of cyber vulnerabilities it's uncovering is undeniable. It's not surprising that some state-sponsored bad actors would be use this as an opportunity to infiltrate too...
In the absence of data, you are assigning blame to things you already hate, like AI or the administration. Motivated reasoning is highly prone to error, and it's a form of stupid-brained thinking.
Microsoft on the other hand, has proven that it will never be reliable.
You can argue that this is a result of something outside of their control, and you would not be wrong, but if the point here is about centralization rather than simply a particular company's operational procedures, then direct strikes on datacenters should be part of that conversation.
I was an Amazon red badge in the EC2 org, fwiw, and do think AWS has excellent operational culture, far beyond what I saw while working in the M365 org, and beyond what I've seen at other tech companies and hedge funds where I've worked. But that doesn't obviate issues with centralization.
If Bank of America's central datacenter (cloud or on-prem) gets hit by a cluster bomb, taking out banking for ~half the US, you can be damn sure that very smart people are going to be working 24/7 until it's resolved.
If you have all your savings stored with a local credit union, say Seattle Credit Union which has 50,000 customers, and they get hit with a ransomware attack... well, good luck. You (probably) won't lose any actual money thanks to FDIC rules, but it might be weeks or months before their services are back online.
Similar to self-hosting vs cloud, you get a bit of a paradox where it's overall better for society if there's no interdependencies so a SPoF outage doesn't impact everyone, but things are much worse for an individual in the event a localized outage does occur due to economies of scale, or lack thereof in this case.
Its pros/cons are known and gaps can be addressed with 3p software. You just keep on old outdated, but proven version of software and keep the perimeter locked tightly.
its the azure cloud that is the wildcard.
Don't forget that MS has the advantage of non-English languages support that many alternatives lack.
I feel like it is very unknown, there is no documentation and everyone relies on comments on random forums that are now 21 years old which tells to set undocumented registry keys to undocumented values.
It's not just Europe! :(
I prefer to ask a different question. Will all this AI development delivering us amazing new software? Are we just going to get 1000 free clones of Adobe Photoshop or can we expect some really exciting groundbreaking new tools? Perhaps all the really clever use of AI development is in the pursuit of better AI and if that’s the case, why?
As to why, well economy must grow, no matter what.
Unfortunately it will take many more outages for folks to realize that serious engineering talent has great value in the AI age. It's their judgement that helps speeding headfirst into building unreliable unmaintainable and difficult to extend systems.
Some other thoughts:
* Will the Internet become balkanised?
* These smaller networks will require a lot of personal information to even gain access.
* The return of the Sneakernet?
Not the same root cause of course, but there's something in the water
not sure if vibecoding is a cause or consequence, but it’s related, it requires as an axiom to stop caring about internals. And it seems to require disregard for quality too.
i'm all for experimentation and adding new tools when they're shown to actually help, but it seems like large software companies (especially banks and e-commerce) just don't care about quality anymore.
Commonly asserted but not true. Most programmers are not just letting the model take the wheel.
> it'll probably be part of the solution.
LLMs can't solve the slop problem they themselves are creating.
All of this is also downstream of what I think is even more important, which is what's better for society in general. Obviously low quality software is not better for society than high quality in a vaccuum, but I also don't think there's a single obvious objective answer for whether the influence of software on society is a net positive or negative today compared to, for example, when computers were all mainframes and all software was produced by people paid to write it. There are a lot of differences in society today compared to back then, and software certainly has some role in how we ended up here, but trying to attribute exactly what and how much is not an exact science.
This is a lot of words to basically say: if you're confident that this is a problem, I think it's important to state exactly why, since I think the interest parts of the discussion are in how you've concluded that.
Maybe it was because I was a lot younger back then and a lot more idealistic, but especially for the ~2005 (i.e. just after the dot-com crash) - 2010 period (just before money would ruin everything in this industry) I can say that the programming bar was placed a lot, a lot higher compared to where I see it placed now. Software wasn't perfect back then, of course, but there was a real push (belief, maybe?) that with enough will and with enough new-knowledge-being-acquired then we (meaning all of us as an industry) will make things a lot better. In part the existence of this very forum is a simptom of that philosophy, what if it (originally, maybe it still is) being written in Arc, or Reddit originally being launched in Lisp.
Vibecoding is an extension of the culture of overrelying on massive external dependency graphs. It's a preference for visual confirmation that something works and a disinterest in how it works. I think it's also related to the tendency of content feeds that are based on likes and swipes instead of searches, instead of specifying what we want, we are reduced to approving or dissaproving (until we are removed from the loop entirely)
Uptime and quality of software is about 10000x better than it was 10 years ago. Things just work all the time now.
Extraordinary claims require extraordinary evidence. You're being the 'trust me bro' in this situation.
The absence of something that once existed is not the same as that thing never having existed. A null entry and a non-existent entry aren't the same.
/s
People "vibing" everything is just another component of this, not the root cause. Using AI tooling is just the new technique for what used to be called phoning it in, or going through the motions, or faking it until you make it.
Unfortunately, it's nearly always been an effective tactic for a selfish few. It's problematic when we don't have an equilibrium that keeps it in the minority...
(The same thing happened with separate company's problems becoming "Big Tech." It didn't help.)
Snarky, but there's a point: Abstraction leads to viewing different things as the same thing. They are - at one level of abstraction. And they aren't at other levels of abstraction. It's not a problem to have both viewpoints.
The trick is that, when someone blends things together, to not lose the fact that they are also separate (at other levels of abstraction).
So I have no problem saying that "optimizing for efficiency and speed" is the common cause of all of these problems, and saying that they all have different (immediate) causes. Both can be true.
I'm not sure "optimizing for speed and efficiency" can count as a common cause, though, because it's not a single event. It's more like a set of events that have something in common.
Now when people have a question, they ask AI, which is wrong a lot of the time.
The main incentive for any nation state to avoid attribution to direct and material harm to many Americans is that they risk awakening American bloodlust. Americans are unhappy about the current Iran situation and wish it didn't start and that it would end already, but sufficient Iranian escalation would turn that around real quick and suddenly there are boots on the ground among other things.
Saying it's not related applies an assumption of what level of specificity you are thinking about. And that's how you quickly de-sync with other people, especially "lay people" who look at you funny when you claim there's just no way these things are related when it's hard to believe that based on experience alone.
As other comments suggest, it probably is related to an extent. Related by complexity of our Internet-based systems, related by age, related maybe even by enshittification of expertise, etc.
The further up the tree you find these relationships, the less specifically actionable they are (you cannot CVE enshittification), and the more they are about "what are the overall social/cultural/human issues we're grappling with in this era?"
Sure, focusing on individual small causes is helpful too, and it's a lot harder to do the higher and higher level system stuff. But, it can be done.
edit, P.S.: It's worth keeping a bare level of suspicions that there could be a common lower level cause, whether through inadvertent dependencies added or through hostile action.
That's the preliminary post mortem from Microsoft.
I don't think we'll ever get anything honest out of the administration for the FAA outage unless Congress really wants to dig into it and make the results public.
Must be the water then
Apparently the FAA outage was caused by the pressure to do things quickly, fueled by the AI urgency.
It feels like all the IT industry is feeling this pressure.
b) there is also a risk of sophistry and language games obscuring common sense truth
In the world where a state actor is engaging in active sabotage as part of a cyberwarfare effort, there is one shared cause.
Which exploits are responsible in each case may differ. Still one cause.
Do I think it's Iran?
No idea.
But the point is, none of us here have any idea at present.
- Massive Microsoft outage - FAA ground stop - Now this outage
Definitely a black swan at least? It’s not even the number of failures, it’s the scale.
I told him it's just like how he keeps telling his patients to watch what they eat, drink and smoke less, and get some exercise, but they don't, and then they have a heart attack and wonder why.
I guess for most “technology” is one big blurry mess.
Wait till they hear about United Airlines.
But I think there's an increasing consensus among "normies" like your coworkers who see these as related. They don't know why but assuring people they are unrelated fails in messaging terms when it feels related.
I think this will be an increasing problem where so much more code is not only written by AI but reviewed by AI. Things will slip through and companies won't be punished for these outages in terms of public perception (because it'll happen to everyone) or by the government. We just don't have serious consequences for corporate malfeasance or gross negligence. Like AFAICT the Sackler family should all die penniless in 6x8' grey prison cells.
Unfortunately we live in a country where the Sacklers get to stay billionaires while 1 year olds are shot dead at the behest of Walmart over a pack of diapers that weren't even stolen... with zero consequences [1].
It feels like this is just the next level of entshittification.
[1]: https://www.nbcnews.com/news/us-news/mississippi-ag-says-pol...
AI is acting as a sudden precipitator for problems that have been latent and growing for at least 15-20 years.
In pursuit of maximally rapid innovation and reduced capital expenditure, the software industry adopted a "move fast and break things" mentality and homogenized code and service infrastructure over a few winning cloud vendors, SaaS providers, and code solutions/frameworks/packages/etc.
The pitch was that you could rely on downstream experts to do better work than you could, that the biggest vendors and publishers had the best experts, that have them invest the capital would look better on your accounts, and that their scale would give you the best value for your investment.
The caveat is that effectively all technology products have serious faults lurking in them, even with the finest expertise working on them (not that most actually had that), and that when everybody homogenizes over the same providers and solution the industry shifts from a bubbling froth of localized bugs to a heavily correlated house of cards where widely correlated failures manifest in widespread collapse and catastrophe.
Whoops.
AI is acting as a breeze against the house of cards, but lots of things could have and would have and did, especially as it continued to inflate year over year.
But you did speak directly to AI, and specifically to advocate for regulation of it, which is why I replied to you. You were being specific and material in a way that the parent commenter was not, and that invited a different response.
You give other people way too much credit.
All of them got laid off at the next layoff. That was before AI.
Why have QA, every developer can simply QA and deploy, and talk to clients, and make sales calls.
Then again I don’t understand Capitalism. At a certain point these companies are so firmly entrenched they can ship buggy half working software. The consumer is effectively a hostage, all competitors are also delivering barely working products.
on trading applications, and banking systems theres huge financial and legal consequences for cutting corners (look up knight capital). Pretty much the only way to get fired is to mess something like that up.
In some jurisdictions if you pushed a change that broke and it was flagged internally as not tested enough someone in the org would quite literally go to jail.
It's good that Iran, Russia, and North Korea are showing their teeth this early, when their attacks can be studied and counteracted.
It's really hard for me to get a sense of how much outages are on the rise - versus every minor issue getting a lot of attention.
If it were an attack, it would be something that were more than annoying. The crypto theft by North Korea, for example, was obviously a bad actor, with a clear motive/benefit.
FAA incident also came like 1-2 days after a new system was rolled out, which would be quite a coincidence if it were not related.
But I don't know, I'm just someone with some minor experience larping in security who is spitballing :)
Nobody is claiming multiple parallel failures. They are claiming one failure that impacted multiple organizations.
Also, I don't think it's that "AI code is inferior" but rather devs got sloppy and no longer review code. Not to say that everyone's lazy but me---a lot of systemic/environmental factors could be the reason.
People were making memes about the GitHub unicorn a decade ago.
Much better than Azure, but that’s not a high bar.
Decades of cycles of layoffs and outsourcing, where the core business or organization no longer operates business-critical or organization-critical functions.
It could be because some critical infrastructure are due to upgrade after a long delay and this is inevitable at some point.
It could be that AI agentic hacking has pushed for some rearchitecture in faster deployment time, which may result in big outage for industry that has so much legacy and used to big bulk deployment only.
Or it could just be because we rely more on cloud infrastructure than previously.
edit: it was Facebook, not AWS
This is a systemic issue that's driven by AI but the responsibility lies with leadership who are still operating on the move fast and break things mentality. With everybody swinging for the fences and the median blast radius increasing and the checks/roadbumps eliminated you end up with a lot of incidents because the total number of merges and the size of the diff has increased by quite a bit per sprint.
Staff-level engineers can do this work because they always have, but if they are suddenly the only ones who can in an org then they are simply overwhelmed.
Like take the Binance hack for example. A naughty hacker, instead of stealing bitcoin, could have just caused mass outage and disruption without stealing anything, but didn't because bad actors usually want some financial benefit.
Like if we learn that PII was stolen, then it's be safe to say that this was a cyber attack.
While there may be people arguing for that, the more relevant point is that regardless of any possible positives of AI code, there are clear negatives that are being largely ignored. Specifically in such outage cases, the volume of code being put into production with little or no review or understanding.
shit programmers have always been a thing, these same shit programmers now putting output from claude straight to production
on top of this there are literally PMs getting involved and doing their own PRs, see vscode recently
No, people want to believe that it is good, despite all evidence. However the status quo will not be returning, because it will get better. The catch is that it will somehow end up in your pacemaker or the brakes on your car while it still sucks.
Clothes. Food. Appliances. Tools. Electronics.
All of these things got worse, but got WAY cheaper. All of these industries had to shed excess labor like crazy in pursuit of optimization at the cost of quality.
Why would coding be different?
This is armchair psychology and extremely bad one because the people who have been concerned with engineering quality have been vastly outnumbered by people who just want to be able to turn their brain off and "ship fast" for probably 15+ years, and that's been reflected in reliability long before LLMs came around.
The code these systems churn out at scale is absolute trash but the financial incentives are to produce out more of it because nobody is ever actually held liable for software breaking in our age
Think system(curl) and random-if-cascades which are never reached - they removed the system(python) in this iteration though...
At this point I think AI-code is just average and probably just fine for corporate environments/SaaS (especially given what thkse produce today), but I still think infrastructure should be a) understood by humans b) produced without installing a backdoor on the dev machine and c) a human should decide what to build and be able to reign in the machine.
Chernobyl was caused by a guy flipping a switch, Challenger blew up because of a faulty O-ring, etc.
I also wonder if Trump's administrations' spokespeople even realize they have a massive credibility problem, and that if they want people like me to believe anything then I have to hear it from a mid-level functionary, not a political appointee.
You say whatever makes your stocks go up and now down, and if you don't, you are stupid because it's normalized now, there are no repercussions, and if you don't someone else will.
No, just no...Chernobyl was caused by the staff doing an experiment that to put it mildly was wildly risky. They disabled safety systems with wrenches (meaning they couldn't easily be reenabled). Challenger blew up because staff at NASA ignored warnings from the people who made the O-rings. Saying these were "straws" is completely irresponsible. Attitudes like this are what cause outrages. Also, unless you are being dishonest, this is the worst string of outrages in the history of tech. There is a cause. It can be found. And unless you think in these terms, you have no business working with a production system in any way.
In other words, the wiring problem might be the wrong thing to focus on - but it probably happened, and the systems likely wouldn't have crashed that day without it.
https://www.latimes.com/travel/la-trw-laxdelays15aug15-story...
By Tami Abdollah Aug. 15, 2007 12 AM PT
U.S. Customs officials said Tuesday that they had traced the source of last weekend’s system outage that left 17,000 international passengers stranded in airplanes to a malfunctioning network interface card on a single desktop computer in the Tom Bradley International Terminal at LAX.
The card, which allows computers to connect to a local area network, experienced a partial failure that started about 12:50 p.m. Saturday, slowing down the system, said Jennifer Connors, a chief in the office of field operations for the Customs and Border Protection agency.
As data overloaded the system, a domino effect occurred with other computer network cards, eventually causing a total system failure a little after 2 p.m., Connors said.
>Do you really believe
Thanks! Conspiratorial thinking hadn't annihilated my last brain cell yet.[1] https://apnews.com/article/faa-smart-ai-outage-08af345749c81...
[2] https://www.faa.gov/newsroom/nationwide-ground-stop-question...
As near as I can tell, they are saying that the communication issues are not related to the new computer system (not causative) - not that the new system is physically disconnected from the communications network.
(The article is a bit confusing, using "connected" and "linked to", which could either be describing physical or causative relationships).
Q: Was this caused by SMART system? A: No. The two systems are not related. SMART is a data aggregator, and it does not feed information into the air traffic control system.
If you dig a bit further the aggregator gets its data from SWIM, which receives (but does not send) data from the system that went down. I believe it's a 1 way VPN connection that they use to aggregate data because SWIM is consumer facing as well.[1]
So unless something went terribly wrong the AI couldn't have had anything to do with it. But that won't stop it being the top narrative for all time because nobody will look into it this far and we no longer believe any official stories about anything.
Don't counter lack of credibility by spreading information you can't verify. It just muddies the water even more. There's people out there right now who think it's the AI apocalypse because a banking system is a bit slower.
It's caused my AI, it doesn't really matter who's fault it is
What's it going to take for the AI pushers to see that maybe this isn't the road to go down.
What's new? What has been operating fine until the AI, cloud, and centralized computing came onto the scene?
Vibe coding, vibe reviewing, vibe fixing. No one has a clue how software works anymore.
Somehow I knew I would find something like this on this comment section.
My first thought for this week's outages has been that people are moving too fast and are, as the saying goes, breaking things.
Basically, blaming AI slop supports a lot of pre-existing beliefs, while blaming AI hackers does not.
"Isn't that the wrong way?"
"Yeah, but faster!"
Cloud outages, infrastructure outages, transport disruption, significant websites going offline etc.
"on a long enough timeline the survival rate for everyone drops to zero"
I also don't see how you would ever end up in this situation if transacting via fb marketplace as you're not even allowed to have accounts that are not you.
What are you going to do if some rando sells you something that doesn’t work? Sue them in court? I’d rather not and just eat the loss. It’s not eBay.
My bank used to let me send checks via online banking (either electronic or mailed out physically by the bank depending on the recipient) until they adopted zelle and discontinued that service. My credit union still offers the check thing for free. That's an easy choice at least for me.
> Zelle (/zɛl/) is an American digital payments network run by a private financial services company owned by Bank of America, Truist, Capital One, JPMorgan Chase, PNC Bank, U.S. Bank, and Wells Fargo.
Banks only allow a couple $k of transfers per day anyway. The company behind Zelle, Early Warning, is a bank-owned centralized fraud detection network as the name suggests.
The ability to send wires from your account is riskier... I wired the down payment on my house in one go.
And your bank will always say it was authorized.
https://www.nytimes.com/2022/10/03/business/zelle-fraud-warr...
"Banks draw a distinction between what they consider scams — when a customer is tricked into sending money to a thief — and fraud, when an unauthorized person gains access to a consumer’s account and siphons off cash."
If you're drunk at a bar and someone unlocks your phone with your face and sends themselves your money, that's gonna be authorized from their standpoint.
Cash, check, wires, ACH, money orders are no different from Zelle in that respect.
You can’t drain your entire savings through Zelle in a single day (unless your entire savings is $3k).
not sure what you're trying to say. I can be stupid with cash AND in my digital life, the choice is mine.
You don't have to follow my advice, for sure.
The median account of money people have in savings is quite low; $3k is a life-changing loss for many. https://money.com/average-american-savings-account/
- Nathaniel Rothschild Nov 5, 2026
- Your bank balance is not how much you have, but how much the bank owes you.
- Your portfolio is not how much stock you have, but how much the broker owes you.
- Your lack of bank balance and portfolio is not how secure your money is, but how much work you owe the world to pay for food and shelter.
Ours was misconfigured as ourdomain.com instead of mailserver.ourdomain.com
Here's their announcement: https://www.spamhaus.org/resource-hub/deliverability/spamhau...
M365 would have needed to be down for a full work week for job adverts to go out for an internal IT infrastructure team.
You also have full control of downtime and recovery rather the refreshing the MSFT status page.
They would/will never admit it is AI breaking everything either.
[1] https://www.mediaite.com/media/weird/flavor-flav-more-than-o...
The thing is, even if true, they'll never admit it. People who make these kinds of mistakes (if this is what it is) are also not very prone to honest bouts of introspection either.
So, your company shit the bed due to your plans. So what? You went to the right school and have some experience in the c-suite. You probably have enough money to go a decade without cleaning out your savings.
Break down the company for scrap, file an IPO for the good parts, whatever. You'll make the money back.
People love to say this but can never point to who these experts are or what their expertise was.
Hello, Congress? Send up 8 more experts!
Ugh. DownDetector's methodology is… not great.
Steam isn't down: https://downdetector.com/status/steam/
Amex isn't down: https://downdetector.com/status/americanexpress/
Visa isn't down: https://downdetector.com/status/visa/
AWS isn't down: https://downdetector.com/status/aws-amazon-web-services/
But each has a huge corresponding spike there.
"User reports show problems with Google"
As the Rick & Morty quote goes, "that just sounds like horrible methodology with extra steps".
Seems straightforward. They could add some qualifiers about the lower ranks somewhere, but that's the base value proposition and it works fine.
> you see the cause of the outage
What does DownDetector say the cause of today's apparent Amazon and Google outages are?
You can't source details that depend on technical knowledge from a non-technical audience, regardless of methodology. Downdetector is useful nonetheless.
You told me only "the top two, maybe up to four" slots count. Five are named in the headline. Only Chase has confirmed any kind of issue, hours later.
(In fact, the article has now been updated to say that Bank of America doesn't have an issue, and suggests it's a Chase-specific outage.)
Grindr CEO: “Yes, it was actually true that there was a significant spike in usage in Milwaukee during the [2024 GOP] convention.”
Not to offend you with all this rigid accuracy, but what you describe is not a cause but an effect.
False positives and false negatives can be worse than no reporting at all.
I’ll also stop eating meals cooked for me if I’d rather have something else.
Is there any other sign they are? That Google, AWS, Steam, Amex, Visa, etc. are all simultaneously having significant outages right now?
> Responding instantly to partial outages that never get reported on status pages seems to be one of DownDetector's biggest strength.
I've predicted all fifty of the last one recessions.
And when it's not DNS (it's always DNS), it kind of depends on how load redistribution works. At some point I have to switch to load shedding, and so Idaho and Montana might just be shit out of luck.
If the NYC office is still able to do work, I don't want the Denver and Chicago office to overload their servers and now nobody can get any work done.
The article writer then went to DownDetector and wrote a headline "Outages reported at Bank of America, Chase, U.S. Bank, Wells Fargo and Zelle" based on just that. As far as I can tell, there's zero genuine evidence for that.
DownDetector is a way for customers to report outages so the headline is not lying at all. It is not claiming that the root cause of these outages are these banks, or that the banks themselves have reported the outages.
Yes. That is basically always the case. Bring it up any day, at any time; DownDetector is always reporting spurious outages.
This story morphed into "AI took down a bunch of banks" already because of an irresponsible headline. "Bank outages" is the #5 trending on my Bluesky (https://bsky.app/profile/did:plc:qrz3lhbyuxbeilrc6nekdqme/fe...) right now, still.
After that our operations team got most of its autonomy back.
How do you make an app that watches everyone else's infrastructure but can't be taken out by a common cause?
DownDetector considers someone looking up "is Visa down?" a report, even if it isn't.
Click my links and it contributes to those "reports".
One provider has a major issue, and people go there and click into non-down companies, which is seen as a spike.
On the other side, does a user google "is Visa down?" going to a website and clicking "yes I think visa is down" any better?
Normal people Google "is Chase down?", find DownDetector, and click it. (Note that the article has a Chase rep quoted saying they do indeed have an outage, and none from other companies.)
Some of them then click into the DownDetector home page and browse around. Suddenly everything is spiking.
Every time I've seen any one major company with issues, DownDetector has spiked across the board. As it is now. Google and Amazon are apparently down.
Really? It seems to me you have to click a specific aspect of the service to report as down once you land on that page to report an outage.
> We process tens of millions of problem reports each month and cover over 36,000 services in 72 countries.
Ask a few normies if they know what it is, let alone have filed a report.
https://downdetector.com/about-us/
> Downdetector collects reports from users and monitors other online sources for service issues.
Or look at the comments on any of the pages. "My card declined"; "18yr femboy down for DM".
It's down detectors all the way down.
Steam/AWS, I got nothing.
- Nathaniel, Rothschild Nov 5, 2026
The thing is - I also think AI can be used to build very high quality software. The problem, I think, is that the typical big tech/VC tech/MBA tech type company (who control most proprietary software at this point) have very little incentive to actually care about quality, and that was quite obvious even before AI.
So I speculate that a lot of problems with AI code are just that it is accepted uncritically because it builds and doesn't have any syntax errors.
Not really a great recipe for good code.
I always defended this, but it appears maybe we don’t have enough developers that take pride in the work they ship. LLM coding made this pretty obvious.
I don't, and I think your comment is rhetorically useless because you've been bullied into making this ridiculous concession.
Agentic coding could be a world-changing benefit, but the current way it's being sold and used as as a cost cutting measure -- produce software faster than ever before with fewer software engineers! Get rid of those pesky experts!
It is a C-level executive problem. With the FAA it is the agency directorship problem. Same issue.
These people, very literally, are trying to run the world with power point presentations and executive summaries drafted by sycophants. 70 years ago these people had actual experience doing actual work and trying to grow businesses and doing stuff at the ground level. Now they are given their positions through a combination of credentials, connections, and political maneuvering. None of which actually relates to how well they can or cannot run a organization.
When reality disagrees with what they get in their emails and presentations then it reality that is wrong. It is the messengers that are the problem, not their competency.
This is nothing new. But the failures in leadership compound over time, like interest to a unpaid debt. They start off with healthy growing companies and thanks to government protections and bailouts it takes decades to for these organizations to decay into total dysfunction. In the past these sorts of people would be removed and their assets reallocated to competent management through bankruptcy and competition. However that natural process is not allowed anymore.
All AI is doing is handing them more foot-guns.
They think they can do better/faster/stronger/cheaper with AI and if AI causes problems then it can just be fixed by paying for better AI. Which they assume is just right around the corner, always.
Just wait until they start to realize that it is
Don't want to get into a political debate here but I'll say that I think that open AI models and access to them is a benefit to society, while closed, proprietary models, controlled by tech billionaires are probably net bad for society.
The same people we already delegate such responsibilities to: the government; ideally, a representative one.
Uhhhh... you mean the corrupt, baby-eating pedophiles who are owned by tech billionaires right?
Cool plan bro
Could you define 'proper training'? I've endured plenty of fucked-up shit from so-called 'professionals/ experts/ trained people' over the last 30 years or so.
I'm currently assisting a couple of vibe-coders improve their 'too easily misused...[and] widely distributed' (available on their sites, or github) tools - I mean slop - that benefit me in ways traditional companies have no interest in. And the updates are fast (daily, mostly) and accurate because, unlike jeremy with a pretty CS degree and a nice job, these people actually give a crap' and don't have a manager to say 'you can't do that'. Also part of being sane is accepting that the cat is out of the bag and big $oftware/ tool manufacturer better get a move on. Disclosure: my interests are not critical to anything; quite the opposite, but people are learning faster and faster with Ai learning faster and faster. Who needs azithromycin if a series 1's and 0's can accomplish so much more? For good or bad.
What a disaster.
No excuses.
[0] https://cointelegraph.com/news/doordash-stablecoin-payments-...
By this metric, I can hop on a supersonic flight on Boom.
But with that attitude, no progress will ever be made and you will continue to professionally complain on HN.
But thankfully, companies using the Tempo blockchain such as Stripe (who built it), and others do not care and already have business interest with the use-case of payments.
I don't take your assertion of certainty seriously. In my opinion, you are not qualified to evaluate the quality or security of code. You are looking at a series of related disasters and shouting that nothing is wrong. Please forgive me for not taking your perspective seriously.
Company process and how LMS are treated in the development process is actually of interest. Are they YOLO shipping code or are they reviewing it and using LLMs as a tool, instead of a replacement for an engineer? That is where LLMs bring danger.
I use Opus 5.5 and it can't generate code anywhere near as good as mine. I'm not an exceptional programmer either, I'm fairly middle of the road. LLMs remain bad at programming, despite the claims of AI bros that only within the last 6 months have models become good (which they curiously have claimed constantly for years).