It always confuses me because the X you need to click is in the upper right and very small.

Not the giant X in the middle.

Horrible UI choices.....