For public transportation to be broadly appealing it has to be clean, safe, and fast. Which means that you have to prevent people who are antisocial (playing loud music, etc.), violent, or just have terrible hygiene from boarding. You can't expect the bus driver to double-task as a security guard, so you have to somehow figure out a different way to implement security enforcement on the vehicles. You also may have to be ruthless in optimizing overall transportation value, of which speed is a factor, which may mean cutting some stops.
You have to have the political will and support to do all this even as the almost inevitable controversial videos hit social media: people being manhandled by security guards while protesting their innocence, people complaining about how there used to be a stop on their street but now it's gone, etc.