It's not so much the temperature per se, it's the fact modern houses are designed around AC and American houses in particular are basically giant wooden garden sheds.

In a traditional house with thick brick/stone walls and large roof overhangs you'd be uncomfortable but a lot less likely to die