Yes buffering / dropping on buffer overload is the right frame and the right way to do it in practice. I have seen it done properly. Yes it can cause some social friction but as long as your conversation partner is aware that because you are driving you may buffer/drop conversation packets and they accept that they might have to occasionally exercise patience or repeat themselves then it's fine.