It doesn't even make sense from a pure cash point of view. It's better for an agent to audit someone making $20M and win a $500K judgement than it is for them to audit 1,000 $25K earners and fleece them $500 a piece. What a waste.
Audits should be exponentially lopsided, not targeted exclusively at the middle class.