upvote
> Can you give an example of an incomprehensible piece of writing (any writing, never mind a proof) that has commercial value commensurate with the costs involved here?

It depends on what exactly you mean by "commercial value commensurate with the costs involved" but I'd volunteer the 3G/4G/5G specifications and the other documentation required to implement the mobile network protocols. 5G is currently sitting at over 50,000 pages and it's one of the reasons Qualcomm/Broadcom/Apple are the only ones who can realistically make a mobile radio.

I don't think there is a single human to whom more than a few thousand pages would be comprehensible at a time except for the occasional genius.

reply
Read the rest of the discussion. The claim is about text which is in principle incomprehensible to humans.

If there exists a text which only one person can understand, that person can communicate their understanding to others, even if that doesn't help them with the original text. That dissemination of knowledge is what provides the value, not the mere existence of the text. If that person forgets or dies before they can share their knowledge then it will be lost.

We have many examples of this from history: ancient texts written in a lost language. These texts provide us with no value until the day they can be deciphered, unless you count linguistic puzzle-solving as a virtue.

reply
> If there exists a text which only one person can understand, that person can communicate their understanding to others, even if that doesn't help them with the original text.

If there exists a text which only an AI can understand, that AI can communicate their key conclusions to others, even if that doesn't help them with the original text.

The only difference here is the amount of meat involved. Perhaps tossing a few steaks on the server racks could help with that.

reply
If an AI can communicate its findings to us in a way that we can understand it, then its findings are by definition intelligible to humans. Your claim was about texts for which this is not possible.
reply
So, you're willing to claim that a conclusion that you don't understand the reasoning for is equivalent to comprehension?

Because, again, I can point to hundreds of examples of texts where nobody but the author understands it, and they're only giving summarized "commandments" that you should follow if you want good results.

If I told you "don't use spin locks, call futex instead", do you think have gained an understanding of the Linux scheduler?

reply
If I told you "don't use spin locks, call futex instead", do you think have gained an understanding of the Linux scheduler?

Yes, because I already knew what schedulers are, what spinlocks are, and if I want to know what futex is I can go look it up. Comprehension is within my grasp.

Your original claim, which you’ve repeatedly distanced yourself from (by trying to use comprehensible examples) but won’t admit to, was about incomprehensible stuff. That is, text that no human could possibly understand, ever.

You’re repeatedly engaging in intellectual dishonesty rather than simply admit that “human comprehension probably will continue for the foreseeable future”, which is really not a controversial idea at all.

reply
Bullshit. Human comprehension will not continue, it will reduced to "when the AI tells us to add Bismuth, strontium, and copper together in this way, we get a superconductor", but that doesn't mean we understand high temperature superconductivity.

For what it's worth, we've known about BSCCO for nearly 40 years, and we still don't have a great physical understanding of how it works, thought we made decent progress in 2022.

reply
That’s still comprehensible. Incomprehensible chemistry instructions simply could not be followed by any human. They would be of no use to anyone.
reply
You're using a very bad definition of incomprehensible. We don't understand the chemistry behind how these things work, it's that simple. If you're going to argue it's comprehensible, you'd better show how it works and go collect your Nobel prize.

All we know is that if we melt the right rocks together, we get a superconductor that works in some mysterious way that we can't explain. We know it's not Cooper pairs.

reply
No, I’m using the right one [1]. You are the one using a bizarre definition for your own purposes.

I can see there is no further productive discussion to be had with you at all. I bid you good day.

[1] https://www.merriam-webster.com/dictionary/incomprehensible

reply
Since it's comprehensible, please point me to someone that can comprehend high temperature superconductivity and how it works, and then explain why they didn't explain it.

With the definition you seem to want to use, it's impossible for anything to be incomprehensible, and therefore it's tautological that there's no incomprehensible LLM output: nothing at all is incomprehensible.

Do you have an example of anything incomprehensible? Anything at all? Even the things that Gödel would say are inaccessible could, in theory, become accessible: we just don't know with absolute certainly that the mathematics it was based on got all the axioms right, though we see no errors now.

reply
Yeah, how many people do you think understand the Linux kernel in full? What percentage of the people using it to great commercial effect can understand it?

How's your understanding of Schroedingers "An Undulatory Theory of the Mechanics of Atoms and Molecules"? You seem to be using the results of it as applied to semiconductor engineering just fine. And, I promise you, most semiconductor engineers haven't read it in full, they just accepted the results as passed on by several layers of teacher.

I have a paper on routing algorithms, which I have attempted to read to my cat. I don't think my cat retained much, but they seem to be enjoying the cat food that got delivered using the results.

I'd suggest that we're going to be a lot closer to the cat than the author of the paper when AI takes off.

reply
You've moved the goalposts. The original claim was about producing mathematics that are in principle impossible for any human to understand.

All the stuff you've listed is understood by some person, and that understanding is the source of its value.

Now that we've cleared that up, can you furnish an example that satisfies the original claim of incomprehensibility and value?

reply
You asked for examples, for a technology that we're still building. Maybe you can see the issue with that?

Anyways, people benefitted greatly from Newton's laws of gravity, even though we still don't have a quantum-compatible set of laws for it. The laws of gravity are still incomprehensible for people, but the approximation that we've observed is still immensely valuable.

reply
No, I gave you a lot more leeway than that. Take any utterly incomprehensible piece of writing from the entire history of civilization and demonstrate its value.

You keep falling back on "incomprehensible for some people" but that wasn't the claim. It was about a text which is incomprehensible in principle; that is, utterly impossible for any human to ever understand.

reply
His examples work fine but you aren't accepting them because they don't confine to your paradox.

Every writing must be comprehensible to at least the author, regardless of whether it has commercial value or not. If I hit the keyboard a few times, I've created writing, but it doesn't mean anything. It is just gibberish and without meaning, so there is nothing to try to comprehend. So if there is something to be comprehended, then at minimum the author should know it.

Therefore what you keep claiming is the only refute of your argument of "an [...] incomprehensible [...] writing" is actually a paradox, and cannot be disproved itself. However "humans comprehending things" is not a paradox, which means that your specific request to beat your paradox is not actually related at all.

His examples disproving the non-paradox version of your challenge (writing incomprehensible to folks other than the original authors) are sufficient to disprove your statement, as he gave examples of both people not comprehending human made and 'God' made writing (the universe/gravity)

reply
That's because his examples are obvious and not at all interesting, since we've already seen them.

His original claim amounts to creating an AI that takes its place above humans as some kind of electronic God, delivering edicts to humanity that we cannot comprehend, but which somehow have value to us. It's unskeptical, pseudo-religious nonsense.

reply
I don't see that at all. Nowhere did this person evoke placing AI above people or even remotely evoke religious imagery. You imagined that yourself, and that creeps me out.
reply
It’s right here:

The age of humans comprehending things is coming to an end [1]

[1] https://news.ycombinator.com/item?id=49312914

reply
That does not place AI above humans and neither does it evoke anything religious.

Look at it this way. AI has destroyed humanity at chess for decades now. That doesn't mean we have placed AI above humans in the general sense.

You have basically totally fabricated what you thought the other person was saying.

reply
deleted
reply
Can you give me an example single piece of writing that the author didn't claim they understood? I don't think that any utterly incomprehensible writing exists.

If you want examples where nobody but the author understands it, examples are a dime a dozen.

reply
So you concede the point then. The age of humans comprehending things is not coming to an end. And therein lies the rub. When it comes to intellectual labour:

Understanding == Value

If a mathematician produces something incomprehensible then it has no value. It's meaningless. Indistinguishable from random noise.

An AI which produces incomprehensible text is producing no value. We didn't need to spend trillions of dollars on LLMs to figure that out. Markov chains can do that job perfectly well.

reply
You may have missed the present tense. I didn't say it's over, but that it will be. Please pay attention and don't make straw men.

Again, do you believe that there are documents, of any value, that humans don't understand?

Maybe an LLM could help you notice what I was saying, since it's clearly beyond at least one human's comprehension!

reply
Again, do you believe that there are documents, of any value, that humans don't understand?

There is no value in an undeciphered document until understanding is achieved, just as a lode of gold ore in some asteroid orbiting a distant star has no value until we can fly there and extract it.

If an LLM can help us understanding something then it was not incomprehensible, by definition.

reply
deleted
reply
But this is just arguing over word tenses. You think "cannot", they think "could". Somewhere between there is the actual crux of disagreement.
reply
Nothing is in principle impossible to understand. It just takes too long, is inconvenient and/or economically unviable.

I don’t find it hard at all to imagine that an AI comes up with a fundamental proof applicable to physics which results in some widget we can now produce that would otherwise not have been produced yet nobody takes the time to fully comprehend why it works. Somebody could, in principle, devote their lives to it and possibly get it, but for what purpose?

reply
There are plenty of artifacts that, if not impossible for humans to understand, then at least no human has ever completely understood. To start with, the universe as a whole. Despite that, we are able to choose legible pieces of it to model and perform useful actions from.

This will shift your argument--that doesn't count! etc., to the point where it's by construction unsatisfiable and vacuous. And it doesn't matter: an LLM might e.g. break some cryptographic algorithm in a way utterly unintelligible to humans, but the fact that it works would be sufficient on its own to make all of us choose to abandon that algorithm and choose different ones.

reply
One person need not completely understand something for it to have value; it's sufficient for there to exist a shared understanding.

an LLM might e.g. break some cryptographic algorithm in a way utterly unintelligible to humans, but the fact that it works would be sufficient on its own to make all of us choose to abandon that algorithm and choose different ones.

No, that is the entire point. If it is an algorithm which accomplishes something useful, then it is intelligible as such. That which is incomprehensible cannot be understood even in part, so it provides no value as a bit of knowledge (unless you're looking for a strong random number source, I suppose).

reply
So, what you're asking for is an example of someone extracting value out of something that is fundamentally irreducible random noise?
reply
> how many people do you think understand the Linux kernel in full?

"Not many people understand some things fully" is so massively different from "the human mind is incapable of understanding some things that AI will understand for us"

reply
Yeah. We're only starting the journey of building tools better at thinking than the human mind, so expecting me to have examples of things it produces is a little hard, don't you think?

The best I can do is things that are incomprehensible to nearly everyone, but still provide value. There's a small leap of imagination to consider an author that understands it and can show others how to leverage results without understanding be mechanical rather than biological.

reply
Can you give an example of a 4-wheeled vehicle that could move at tens of miles per hour before the automobile was invented?
reply
I know right? And there’s only a market for maybe 5 computers in the whole world.

Paul Krugman (1998): predicted the internet’s economic impact would be no greater than the fax machine’s.

The 1876 Western Union memo dismissing the telephone as having too many shortcomings, and the banker telling Horace Rackham not to invest in Ford because the automobile was a novelty.

We are in good company!

reply
Past performance does not guarantee future returns.
reply