In time one of the big tech will solve the pervert issue by randomizing / anonymizing every face in your photos that's not in your personal network. Once this is done / achieved no one will call them pervert glasses anymore. Im surprised Meta hasnt done this already! They really should!
That doesnt mean 20 million smart glasses wearers (miniscule population of all are weirdos/creeps) are gonna stop wearing what some others don't like. It's just like smoking. People didnt go up to those smoking and punch them in the face or threaten with violence. Rather laws were made and if no technological solutions is made (serious think Apple is the company that will) maybe laws will that forces such to happen.