This is what I am getting at. If this were true - and I've yet to see evidence it is, despite some anecdotal evidence (organizationally, IME, it's about 2-3x for power users, and probably a net loss of productivity in certain areas) - why would their headcount be growing so much still YoY, pretty much doubling every year. If the AI is 10-20xing why such a big jump in headcount? Yes, the numbers are shiny, the growth is apparent, I would just expect with this AI narrative they'd be "doing more with less" as this thing improves every year.
> The AI usage still needs a knowledge worker to direct it in ways that it can't direct itself, so you still need the employees.
This is the story AI sells though, and Anthropic has participated in it heavily. Yet, their interview process requires hard skills and doesn't let you use AI, so clearly, what you're saying is correct, it just doesn't really align in my head with the whole knowledge worker being replaced narrative.
That wouldn't really be an expected outcome for a company like Anthropic. They need to do the maximum they can with the funding they have, or risk losing out to competitors who don't take their foot off the gas.
But it's also true that when I'm working on 2 things at once, the bottleneck is me. I'm spending all my time giving Claude direction that it can't give itself.
So you basically have to separate out the tasks where AI can produce a 20x productivity boost, and the stuff where it can't help at all.
There's still so much stuff where it can't help at all, you need real human employees for that. That's why Anthropic is continuing to hire at breakneck pace.
And that's what I'm saying -- knowledge workers aren't being replaced. They're just accomplishing tons more work, and companies aren't running out of work to do.
I was recently involved in a case like this - we had a critical part of our system based on a dependency that's no longer maintained. Previously, we would have just carried on for a year or more, living with the limitations until it was much closer to being entirely untenable, because rewriting the code in question would have been a multi-month project involving multiple developers, QA, and management time. But now, the code in question was migrated in a few days using AI, along with a suite of new tests in addition to our existing ones, that gave us a lot of confidence in the results. The productivity improvement here is at least on the order of 25x, possibly higher.
But most developers aren't sitting at their desks operating at a 25x pace all day, every day, so average productivity improvement is going to be lower. And of course, some use of AI will be suboptimal or problematic: waste due to e.g. duplicate development which happens when development is so easy, or costs for cleanup of mistakes.
We also now have a slew of AI-generated internal tools, most of which would never have been developed before. Many of them are very useful, the kind of thing that's on your eternal wishlist but never gets done. Some are kinda useless, so represent wasted resources. It's difficult to measure the productivity benefit of all this, because you'd have to compare it to the non-existent company without those tools.
Ultimately, measuring all this meaningfully is not really that feasible, except perhaps over the long term. Managers operate on vibes with this kind of thing because in many cases, that's all you can really do.
And the product now iterate 2 times faster with 10 times more bugs and customers are pissed.
Looking at you Apple: https://aperocky.com/blog/post.html?slug=apple-watch-sucks