When I studied psychology 20 years ago we had a class which covered this, and at least then there were studies indeed showing these associations are exactly due to these phonetic identifiers.