No individual holds power over connotations. Language just evolves.
Okay, but I still reserve the right to be pissed off at teenagers using 'out of pocket' when they mean 'off the wall' or 'out of bounds'.
I do sometimes rebelliously use words in their original connotation along with an unnecessarily lengthy explanation. Never anything that's now an insult, of course, those I just stay away from and am not mad about either.
I do wonder whether adding chips or bacon to counteract the cloying one-dimensional sweetness of the other ingredients would make me a fan though... chunky natural PB, blackberry jelly, hickory-smoked bacon on ciabatta? Hipster PbB&J might be the ticket.
If I know a given wording is widely misunderstood, to the point I'm planning to immediately follow it with a clarification - often that's a sign it's not a very good wording.
There are exceptions, of course - go ahead and say Cephalopods (things like octopuses and squid) if you're a marine biology educator.
So yeah, sure, context does matter.