I'd say he crossed the line when he openly supported ethnic cleansing via remigration. I.e. deporting legal citizens that aren't the right race. If you don't think that's racist I don't know what it would take...
Before that I'd have said he was on the edge, but now it's pretty clear cut.