It's a double whammy, the model is too big to realistically "move" so it has to be smaller, smaller models cannot become that intelligent due to well.. math. Therefore it is science fiction.
replyThat problem just requires there be big GPUs to hack into. The number of those sitting around will keep going up. Very much not scifi.
replyA couple terabytes aren't that hard to move around. And you can split a model across many many GPUs if you'll tolerate it being slow. And you can run many parallel threads to keep up throughout.
why is it not possible for a "big" model to contain a hidden super intelligent sub model? or a distributed model?
reply