Many/most people don’t, and haven’t for a very long time. Being afraid of losing one’s job is quite a step up from being afraid of a rival tribe ransacking your village. Or a predatory animal. Or bacterial infections.
Obviously, things could be better. But they could be much, much worse.
This has probably been true only in the last 300? 500? years. Before that, things were the same for 1000+ years for most of civilization, barring any large invasions from neighboring kingdoms, or some far away empire (mongols etc).