Like Terence I also had "out of band" classes and free time to read advance material in both primary and high school.
During that period Australia also had good federal and state programs for clustering advanced kids on yearly subsidised specialist camps - optional and free if parents couldn't afford to chip in.
I bumped into him at the same time Paul Erdős was doing the rounds and hanging out with anyone that might show promise.