Not all training data is human generated, and it's also not clear that being ridiculously good at interpolating between data points (whatever that means) will not lead to superhuman capabilities.
replyI could make a robotic picture coloring machine with truly superhuman capabilities - picking only the most beautiful color combinations and staying 100% in the lines while finishing entire murals in < 1 second. However, if you need a completely new and original image rendered, the machine is of only partial utility for you. It is very well possible that your cure for cancer (if that's even feasible) or whatever else you desire is a completely new picture.
replyWe have these breathless conversations about the new AI frontier at the peril of losing sight of reality and our own human potential.
>these models are still only interpolating between human-generated datapoints fed to them. They cannot reason beyond the data they've been given
replyAre you sure that humans can?
Didn't a SOTA recently solved a mathematical theorem, one escaping mathematicians for 80 years?
Maybe a human "novel" invention is just a good interpolating from the datapoints (knowledge) fed to the human.
Your phrasing ("you forget") implies this is a fact and common knowledge, while in fact there's little reason to think that's true.
replyDo you know if anyone has trained, say, a pre-2017 model and tried to get it to come up with Attention Is All You Need? If it did, would you say that was only because it's a synthesis of prior art? If so, what isn't?
replyAllow me to restate my point: human beings and AI both create via synthesis, but we are the only ones capable of what we could categorize as true original thought or creativity. It could be argued that nothing we do as humans is truly original or creative either, but I would counter that with the claim that an LLM could not have created any element of the society and culture that gave birth to LLMs. Maybe in six more months.
reply>human beings and AI both create via synthesis, but we are the only ones capable of what we could categorize as true original thought or creativity.
replyAnd how is that anything other than synthesis? Do we pull concepts out of thin air?