I like to call it the great incoherence.

Even before LLMs it was feeling like the design of society wasn't really for people any longer, instead it's more and more designed for corporations and their convenience. In the US at least. Same with how the internet has stopped most people with socializing the same way they did in the past.

Now we have a new layer that will be optimized for these digital entities. We see it in writing all over the internet. There will be tons of other places they show up and doing things that don't make sense to us.

I don't see how this is possible. There are constraints on the speed at which information can move and the number of steps required to compete a given task. The improvement cannot continue, let alone accelerate, indefinitely without bounds.

I think what makes it hard is that it's quick, but not sudden. I understand constant-rate improvement. I understand what it's like to be in a car crash. What I can't understand, emotionally, is the constant acceleration. Even now, if I look at an OpenAI solution in isolation, I can understand the big picture, so if things froze where they are I could adjust. Intellectually I know I'm not going to get that chance, but emotionally I don't.