Wear a burqa if you want total privacy while in public. Or prosthetics, I guess. I've seen people wearing full-face reflective shields in public - but that was mostly as a sun-shield to protect their ever-shriveling faces. The only thing stopping you from having real privacy while in public is social norms.

Other than that I don't see a way to remain "private" while in "public" with the current laws that we have, and I kind of like the laws that we have.

These are the same laws that let us record law enforcement, which is especially useful when they abuse their power - something that happens far to often. If the laws around recording in public were altered, then we likely also lose that right, and then law enforcement becomes even more dangerous to the citizens.