> Still annoying?

Naturally it is extremely rude. If two people have a conversation in public both pay attention to the surroundings and feedback to change their volume tone and topics. If you put someone on speaker without introducing everyone present then they should hang up on you.