My understanding is that he was alarmingly drunk when they went to film his dance sequence with the chimney sweeps in Mary Poppins.

Alarming in a "Mad Men" era of drinking...