More efficient AI is possible in principle but when the next breakthrough arrives there's no guarantee that it can be implemented on current hardware architectures. Something fundamentally different may be needed, as different from current GPU/TPU chips as they are from regular CPU/FPU chips.
replyThe existing biological evidence took billions of years of evolution to get to the state it's at. So it may not just take research and discovery but also enormous computing power.
replyEvolution is really slow as you say. It even stops moving at all without selecting pressure.
replyYes, one might call these… evolutionary algorithms…
replyExactly. Even putting aside “better”, brains show that orders of magnitude greater efficiency are possible, for training and operation.
replyIndeed. It feels like we're at the equivalent of what the original IBM PC offered in the personal computer revolution.
replyJust seeing how much has progressed as far as capability in the past 4 years as far as capability and efficiency, it's clear that there's so much more to learn and refine from.