I think the former group almost certainly outweighs the latter group at least in the Western hemisphere, but I know the Western hemisphere has been steeped in a deep malaise of anti-optimism for several decades preceding AI to begin with. That it's almost a game to identify all the ways anything new might be bad, rather than celebrating the obvious ways they are good. And this penchant invariably biases their developing opinions of all new technology, be it AI or anything else.
Space, nuclear fusion, advanced fission, the internet since about 1993, blockchain, anti-aging, I've been a big fan of all of it. But I've read the AI safety arguments and seen what a lot of researchers say about it, and I'm seriously worried.
Ignorance is bliss