No. that's exactly not what is said.
it only is applicable to organisations and people who very clearly express not only some disagreement, but their intolerance and their plan and intent to enforce suppression of dissent once in power. and then suppression of whatever they are intolerant of.
and the far right very clearly announces that they will "eradicate" and "put to their (lower) place" whatever. immigrants. homosexuals. transgender humans. wom(b)en.
if you tolerate _that_, even pay for it, in times of ai boosted slander, you get queers in prisons, pregnant teenagers, and a few much richer very rich people.
-- Joseph Goebbels, 1935
The whole point is that fascist movements will abuse your tolerance to build themselves up to a position where they can take it away from you. The only answer is to not tolerate the intolerant.