They might actually be a bit stupid, but maybe they'll do it if you tell them it's because you are worried that you would fall for a scammer impersonating them. That at least would let them keep their stupid pride.
You don’t even need this. You just ask “what did we do last Tuesday”. A scammer will hang up, even if the actual answer is “I haven’t seen you in two years”.