>roughly "continual learning, with ongoing generalization and merging of memories, with no catastrophic forgetting, with graceful degradation".

Sounds a bit like real-time "distillation" to me.

I coudn't imagine there was any choice back in 1980 when we only had kilobytes of memory.