> The toxicity comes from the intellectual profession having to function as a modern clerisy for socioeconomic reasons under post-neoliberal capitalism.
Sure. And I think (Western, post-neoliberalized) math has resisted that corruption possibly better than any of its sibling cultures. But what makes the toxicity "distinct" is the emphasis on enlightenment, as if being a top-class mathematician brings you closer to the Godhead than does, say, being a top-class chess player, or a top-class defense attorney. Mathematical theories are treated less like robust human creations percolating over decades and more like divine revelation channeled through chosen disciples in fits of inspiration (c.f. Cantor, Galois, Godel, Grothendieck). A lot of this is projected from the outside the culture into it, but it is not outright rejected by the culture. Instead we still openly endorse what amounts to Great Man theories of mathematical history, attributing to almost every noteworthy mathematician a moniker of "genius" and praising them as paragons of thought, not as the unhealthy subjects of cults of personality.
In other words, the move to experience and cultural relativist statements about "math culture" is exactly the cynical ideological move that an academic cleric does. It deflects from examination of where these narratives come from and attribute it to e.g. "math history" or "math culture" or just "something specific to math itself" etc, etc.
Neoliberal intellectuals love to attribute toxicity to the Enlightenment. They can't help it.
Simpler conflation: need and ability
Eg
1. "from each according to his ability (the tyranny of academy)" with "from each according to his need (the freedom afforded to clerisy)"
2. "to each according to his ability to get rich" (meritocracy) with "to each according to his need to get rich" (post-liberal capitalism)