Digging into it just now, an important distinction I initially missed is that they worked on the original arcade cabinet (all game logic implemented directly in hardware), which predated the 2600 and its software version by several years (by which time they had already founded Apple).
It's literally one of the "big prick" items of Job's history, along with disowning his own child.
It was heartbreaking.
With Woz at the helm, Apple would have gone the way of Commodore and Atari, it's a good thing he got out.
What would have Jobs been?
An Apple that made little more than the AppleII and ran it's course would have been a perfectly fine thing.
We would all be far richer for having 20 different companies in place of the Apple we got.
I started coding in 1981 on an VC20, learned a lot from it, but wonder how did the world benefit more from vic20s?
As a happy smartphone user, I think the world did benefit a lot e.g. from the Newton (loved mine, dropped a Palm for it, sad it died, but it was too heavy).