Well, the analogy is to something flying by a black hole and having its trajectory altered.[1] It sounds like it fits you, then -- you interacted, and are now forever irritated by them or by things that sound like them, even things that you would not have previously noticed.

[1] This is just gravity, nothing specific to black holes, so the analogy isn't doing a lot of work here.