>We have an existence proof from biology in the form of natural intelligence that much greater efficiency is possible.
replyIt's only a proof that it's possible with 18+ years of training.
In certain ways my dog has more generalized intelligence than any LLM, and I trained her in only a few months with a modest investment in dog treats.
reply>from biology ... much greater efficiency is possible
replyThose are much more specialized models with pretty mediocre tokens per second.
Perhaps tokens is a dead end?
replyPerhaps! But perhaps whatever human brains use instead of tokens is not as amenable to scaling or copying.
reply[dead]
reply