upvote
>> To me, this is more or less what I would think "Artificial General Intelligence" is

So then you need to explain ARC-AGI-3: https://arxiv.org/abs/2603.24621

"Our testing shows humans can solve 100% of the environments, in contrast to frontier AI systems which, as of March 2026, score below 1%."

Back 1996, EQP automatically solved the Robbins conjecture. But nobody concluded EQP was generally intelligent.

https://www.cs.unm.edu/~mccune/papers/robbins/

reply
> So then you need to explain ARC-AGI-3: https://arxiv.org/abs/2603.24621

I don't, we originally had the turing test which was designed to determine human intelligence by its ability to imitate us with natural dialogue, but we've since defeated that. I stated "to me" because it's my personal opinion on a definition whose goalpost will probably never stop being moved.

> Back 1996, EQP automatically solved the Robbins conjecture. But nobody concluded EQP was generally intelligent.

EQP doesn't have the 3 criteria I outlined, which were different than "solving a math problem"

reply
Would you trust a bridge built by it with zero human interference? A train? A plane? A skyscraper? What about fight in a war? Unless you can, I wouldn't consider it AGI, because you're actually trusting human intelligence to verify the bridge or train or plane or skyscraper is safe or that the robot is following orders. And even then, you're trusting human-influenced guardrails etc. I would consider it AGI when an AI-created LLM can do all of these things and you trust them with your children's lives. Would you trust an AGI cop to protect your children from a violent criminal? Unless you can, believing what we have as AGI is just an empty opinion with no meaning behind it.
reply
Would you trust a bridge built by a single human? In reality, we have lots of guardrails to ensure that we don't screw up and kill a lot of people by deploying defective bridges (or cars to drive on them). Those guardrails often are written in blood, and still occasionally fail.
reply
Why not have AGI check other AGI? Peer review by fellow humans is what gives humans assurance, to the degree in which review was done by peers of equal or greater intelligence.

AGI checking other AGI should give you that same trust, no? Deepseek says my ChatGPT bridge is stable, you should trust it. Claude says it's stable. The humans say it isn't, but they aren't AGI. You can trust this bridge because it's been vetted by AGI. In my opinion, LLMs cannot be AGI, so for me I would never trust them above any human I would trust. But for those who do believe LLMs can be AGI, they have to demonstrate why we should trust them above any human in these extreme cases. Meaning, if someone says "Well the department of safety (ran by humans) says it's not safe" we have to believe that AGI just knows better than the department of safety. I think this is not possible right now, which is why I don't think we can trust anything built by LLMs where we need the tolerance of risk to human life and safety to approach zero. American AGI soldiers invade the home of Iranian citizens because they have been identified as terrorists. Do you trust the AGI to know if the visual scan they see in this civilian home is a threat to the interests of the United States government and its citizens?

reply
One step further, our current generative AI is not discrete. “AGI checking other AGI” doesn’t really make technical sense. Currently, every interaction between two generative AI units is treated as agglomerative. We talk about “Claude”, not the 70 subagents that Claude spun up to achieve a task.

In other words, as soon as two generative AIs interact, they become one. Our current definition of AI (generative AI operating in feedback loops) is dependent on that.

reply
I would be extremely surprised if something as elegant, terse, and useful as the Fourier Transform had been missed by human mathematicians up until now. All expressible theorems are enumerable, after all (if we limit ourselves to a finite alphabet). It seems likely that any new theorems are long, highly complex and esoteric, regardless of human or machine origin.
reply
Shannon was 1948, one-way crypto in 1978, univalence/HoTT something like 2007; I would be surprised if there weren’t simple new fundamental primitives out there! One problem is that some great advances are from viewing complex objects in a simple way, which take a lot of characters to define in formal logic but which are “simple” in platonic maths-space.
reply
1. The computer is going to struggle to recognize elegance. I’m not sure it’s relevant at this point (but who knows).

2. The statement about proofs is just way wrong. It doesn’t sound like you are familiar enough with them.

This isn’t exactly what you implied, but witness the very short disproof of the Jacobean Conjecture.

reply
That’s not the criteria outlined in the quote you just used.
reply
IME, LLMs are primarily good at grinding through cases, which is why you see them pushing upper and lower bounds and finding counter examples.

I spent a few weeks working on a number theory proof with Claude off and on and it spent hours and hours and hours grinding through one shape of polynomial after another, reporting "progress", and it's true, it proved what I was trying to prove for more and more classes of polynomials, but it was biting off pieces of an infinite tower of classes with no hope of closing it for _all_ polynomials.

That happens to be a good way to find counter-examples, though, and when I posed a slightly different version of my problem, it found a counter example in about 90 minutes.

And in fact, finding the counter example for the related problem allowed Claude to finally prove the thing I wanted to prove to begin with, by lifting the problem to a characteristic where that counter example didn't exist, proving my question there, and then proving that it still was equivalent to my original question.

reply
I share the same thinking. What do you think is a good way to try to define this "elegance"? If we try to use the mental framework of

Step 1. LLM "brute forces" a search

Step 2. We train on this trace

Step 3. In the next model, LLM internally makes a "shortcut" for this path and "brute forces" it quicker (or one shots its in the best case)

And we want to ultimately show why that definitio evades this framework.

reply
deleted
reply