Maybe the observers recognized that the ape men had figured out how to harness the power of the atom and that it was only a matter of a short amount of time before they ruined the experiment and decided to leave

The Manhole Cover!