You do you but as a cyclist you are super vulnerable to all manner of things and I'd never want to give up that kind of awareness.

If you listen carefully you can usually hear a cyclist behind you who may want to pass or is passing you, and having headphones probably makes that a lot harder

>I do that. This was never a problem

The most problematic people in traffic are never aware that they are the problem.