Why the pole specifically? You could probably build a second IceCube 100 miles away, but how are you going to get that materials there? Pole has a skiway for large aircraft and infrastructure to house a large number of people. The traverse (SPoT) only became operational near the end of construction - the initial holes were drilled in 2005 and almost everything had to be flown in.
Telescope In The Ice does a great job of explaining the history and science behind the experiment.
I'm personally very happy that we're still funding science that isn't obviously monetised.
The reason for Antarctica is that it's the only place you find cubic kilometres of stable ice that doesn't drift around.
1: Ice-mass that isn't contaminated by atomic testing fallout (if the ice has been there since the 40s it's without radioactive waste (faschinating to read about how WW2 wrecks is a prime resource of steel since it's a huge amount of steel without trace amounts of radionucletiods from testing fallout).
2: No current interference (nuclear power, radiowaves,etc) creating possible test uncertainties.
3: I'm sure there are other reasons
The negative naturally is cost, but since the expriment succeeded it will probably be useful for any attempts to send robots or even humanity into space beyond the solar system.
The US has a research station at Summit Station Greenland but compared to South Pole, it's spartan (like, the first time I went there, I slept in a tent because of lack of hard-sided berthing, but then a Polar bear came a few years later and now hard-sided berthing is required). There are longer-term plans to improve the station in Greenland but we'll see.
https://en.wikipedia.org/wiki/Sudbury_Neutrino_Observatory
https://en.wikipedia.org/wiki/SNO+
https://en.wikipedia.org/wiki/Super-Kamiokande
There's a weird overlap in engineering and physics disciplines between the hard engineering/business practices of the mining industry, and particle physics.