> the conspiracy aspect is alleging a conspiracy without providing any evidence

Nobody alleged a conspiracy.

> Calling someone a liar because you invented a conversation in your head isn't entirely sane

That's not why they said that. This is a ridiculous criticism of OP.