upvote
Arguing the definition of original is pointless for the exact reason you point out: that it's ambiguous. Due to the nature of how an LLM works, it cannot make anything truly new, it, again, can only recombine and remix things from it's training data. This is why AI images/writing are so easily spotted, and even AI code to a degree: they have a distinct "style" as a consequence of how they work.

I leave what is truly original to the philosophers. What I can say for certain, is that anything you get out of any of these models is a remix of what is present in it's training data, because gravity exists and energy is conserved. They are not intelligent, they are not conscious, and they cannot make New things.

reply
> What I can say for certain, is that anything you get out of any of these models is a remix of what is present in it's training data, because gravity exists and energy is conserved.

But doesn't that same argument apply to humans, where 'training data' = all our sensory inputs (plus what's encoded in our DNA, depending on whether we want to analogise that to the training data or the underlying architecture)?

> Arguing the definition of original is pointless for the exact reason you point out: that it's ambiguous.

I'm not trying to be a smartarse here but you are the one who is claiming absolute certainty that something is false 'by definition', so I think the onus really is on you to have a precise definition in mind.

> They are not intelligent, they are not conscious, and they cannot make New things.

I'm not a consciousness denier or anything, in fact I think it is the most important thing in the world, but I don't understand the connections you're making here. 'Intelligent', like 'original', can be defined and needs to be defined for this statement to be meaningful. 'Conscious' is probably inherently slippery, but if we mean the same thing by it (having subjective experience/qualia) then I have no idea how you could be certain that any other entity lacks it. And it seems like you may be implying that consciousness is a necessary condition for originality, but I don't think you've explained how.

reply
> But doesn't that same argument apply to humans, where 'training data' = all our sensory inputs (plus what's encoded in our DNA, depending on whether we want to analogise that to the training data or the underlying architecture)?

That is true if your model of the human mind is akin to a machine model you also use to describe today's computers. But that is a huge assumption, making the argument somewhat circular. We don't really understand the human mind and therefore don't know if there could be other models for it which are not equivalent.

reply
If you think the human body is subject to special laws no other object in the universe is, feel free to present your evidence. No model of the human brain can exist that violates the conservation of energy and thermodynamic laws regarding entropy and information. If you have one, feel free to present your groundbreaking results.

If there has to be something breaking the current known physical laws, the best chance to find it would be in extreme conditions like black holes or stellar cores not in close to STP conditions like the human body.

reply
> Due to the nature of how an LLM works, it cannot make anything truly new, it, again, can only recombine and remix things from it's training data

Fwiw, David Hume made this exact argument about human imagination:

> But though our thought seems to possess this unbounded liberty, we shall find, upon a nearer examination, that it is really confined within very narrow limits, and that all this creative power of the mind amounts to no more than the faculty of compounding, transposing, augmenting, or diminishing the materials afforded us by the senses and experience. [David Hume — An Enquiry Concerning Human Understanding (1748), Section II, Paragraph 5]

reply
Everything is either deterministic, random, or a mix of that.

New is just a mix of deterministic and random. LLMs are not deterministic.

You don't even need an LLM to create something new and improved. Evolutionary algorithms have been doing it since the 80's.

reply
> Everything is either deterministic, random, or a mix of that.

What makes you believe that?

> New is just a mix of deterministic and random.

... or that?

reply
Because there is nothing else.

Every action ever in universe is the effect of either something deterministic or random. There are no causes or effects that can't be put into one of those bins.

The only "out" here would be deterministic actions that originate outside the universe, but we have no evidence of that. It also doesn't escape the deterministic/random duality.

reply
"There is nothing else" is a very common belief to be upended when our understanding of the world improves.

I'm not saying you are wrong but I'm trying to be careful with such absolute statements.

reply
Nobody is claiming new forms of energy or phenomenon can't be found. As of yet though most such were found in more and more extreme conditions, starting from radioactive substances to particle colliders and astronomical phenomenon. There is a much lower chance to believe something fundamentally or radically new phenomenon in physics to emerge from human bodies.
reply
Non answers are best ignored. You have failed to define what creativity is and therefore failed to prove whether llms are "creative" or not.

What exactly are you trying to say about gravity and thermodynamics? You may be confused but these are universal physical laws that apply to everything, humans, computers, anything else.

At its most basic level if I had to start with defining creativity, it should be some kind of intelligent filtering process. The brain can be in a huge number of state configurations, the interesting and novel among them are "creative" ideas. We can build upon it further. I am happy to say I am no philosopher and I will defer to those with expertise on it. But if you don't have any definition for it, its quite strange to make up some beliefs about it without proof.

reply
You’re the one who said “ By definition an LLM cannot create original work”, so I think responding asking for the definitions you are talking about is quite justified?

Often when someone says that something is true by definition, their claim is incorrect.

reply
Does your same argument hold for humans’ inability to do more than remix? Gravity exists and energy is conserved for us, too.
reply
deleted
reply
Arguing the definition of original is pointless for the exact reason you point out: that it's ambiguous.

Well, it certainly wasn't "ambiguous" two posts ago when you said "Absolutely not. By definition an LLM cannot create original work." Make up your mind.

You've been beating this drum since roughly GPT 3.5, as I recall. Your goalposts aren't even on the field anymore, they're gathering dust in a far corner of the parking garage down the street from the stadium. Time to update your priors.

reply