upvote
Claude solves two open problems in the physics of black holes

(www.anthropic.com)

81 comments so far (82 as of now) and I haven't found one that is actually about the papers or even TFA. What are we doing here?
reply
Good, thanks. How about you?
reply
The intersection between physicists and hacker news commenters is probably quite small.
reply
There was a time not too long ago when I'd learn a lot from HN comments on posts about physics.
reply
I get that, but I think we can try. I know there are at least some physicists here, from other threads about AI and physics, but we could at least talk about what this article is.

For example, the metaphor they give about walking from Penn Station to the High Line comes off as somewhat out of touch.

reply
Well, it's really simple.

Most people here care more about defining what AI is and whether what it can do really is "physics", than about the advance of humanity.

I dunno, I'm not one to say "HN was better before", but I did get bored a couple of years ago with all the "akshually, it's not real AI until it can solve [this problem], anything else is just sparkling inference algorithms".

(And of course the goalposts get moved so often, they need an amazon prime subscription just for the free delivery)

reply
> I'm not one to say "HN was better before"

I would make a comparison to illuminate the phenomenon I'm seeing in the rest of this thread, but unfortunately there is a specific rule artificially preventing me from doing so.

reply
It tickled me that this was a bullet point in the Fable 5.2 announcement. I like that we're now at a point where "solved two open problems in the physics of black holes" is the kind of thing that shows up in a frontier model launch.
reply
Copying my comment from that discussion:

Those theoretical physics papers look like the real thing (i.e. not mathematical physics like the OpenAI Yang-Mills result). It looks like AI is finally branching out of math.

https://news.ycombinator.com/item?id=50430239

reply
> It looks like AI is finally branching out of math.

Is it really, though? It's still a heavily mathematical domain, rather than one involving empirical research, where AI still struggles.

reply
In my (limited) experience it does not struggle with empirical research — at least in the procedural aspects thereof — as long as it has access to the right data.

It is very good at understanding research goals, identifying appropriate datasets to work with, doing data wrangling and data science, determining appropriate metrics, running simulations, analyzing results, writing up reports with charts and tables, and proposing follow ups or “high potential next steps” which show a surprising amount of judgment, and if instructed to, executing on those too.

I use Astra and Fable (who delegate to cheaper models for coding) and have them review each others work, and only spot check things when they are done calling each other out. I rarely find issues, and when I do, it’s usually a misunderstanding of intentions.

I’ve only explored a few areas though, including computer vision, vector search, and wireless signal processing, all in applications that, as far as I can tell, are genuinely novel (though of varying levels of novelty and economic value, as the models are fond of pointing out to me!)

I prefer being in the loop and setting the direction — because I do not have unlimited tokens, hah! —- and I regularly identify new directions they had not considered or had prematurely dismissed… so I am a bit more useful than just a financier of tokens! But I can totally see how they could grinding ahead by themselves and brute force useful results, especially if given very concrete goals like a theorem to prove.

I don’t think we’re at Recursive Self Improvement yet, but I don’t doubt for a minute that this is behind the insane pace of development at Anthropic and OpenAI.

reply
In empirical research, getting the right data represents the bulk of the intellectual effort. Designing the right experiment and collecting good data is painstaking, backbreaking work.
reply
I agree, and this may be nitpicking, but would it not be more accurate to say “bulk of the effort” rather than “intellectual effort”?

My perception is that most data collection, once designed (which does take considerable thought, as you point out), is a slog of executing rather mechanical processes over a long time. (Which is what RA’s and lab assistants are for!) For sure, regular analysis is needed to ensure the right data is being collected and no confounding factors are sneaking in, but seems to me the majority of time goes into the relatively rote work of setting up equipment, running experiments and recording the results.

I do think that with access to MCP-enabled equipment, AI would be ideal for this too, given its infinite patience. The problem, as with all other fields, is this would rob novices the opportunity of building the necessary intuition that comes from spending time in the weeds.

reply
I'd argue that "the right data" should really be called "the right information in context."

Context is king.

reply
I agree, but it is the kind of math done the physicists' way (which I found recently asserted that AI cannot do) and not the kind which is formalizable in Lean.

"It's not much, but it's honest work."

reply
From skimming the papers, it’s not clear to me what it is actually doing outside of proving what can be considered mathematical theorems (even if that’s done the physicist way). It doesn’t seem to be making testable predictions (but maybe I missed those).
reply
> and not the kind which is formalizable in Lean.

For people not in the know, it's common - both now and historically - for physicists to use "mathematical techniques" that have not been proven valid.

I took grad level physics courses, and this drove me bonkers. I was accustomed to the comfort mathematics provided me. If something was unclear, I could always dig deeper and find a proof. But a lot of the stuff the physics professors would do - I couldn't, and nor could they. They just responded with "intuition". Some of them had dug deep earlier in their careers and stated that the technique was likely invalid mathematically, "but still useful in getting answers experiments can verify".

I won't even talk about relying on diverging series...

reply
Can you declare theorems in Lean for those techniques. And list them in the paper.
reply
Why would it not be formalizable in Lean? People are formalizing parts of linguistics in Lean.
reply
Most famously: to a physicist, the sum of all natural numbers is -1/12 https://en.wikipedia.org/wiki/1_%2B_2_%2B_3_%2B_4_%2B_%E2%8B...

If you attempt to formalize math involving such assumptions, one expects to encounter a proliferation of contradictions. So I’m curious to see how the contributions of AI authors is handled by the physics community. With pure math, you can ostensibly write a compact statement of a theorem in Lean, and if so, trust the process.

reply
OK, that goes right past me. However, the reference, in the wiki article, to https://en.wikipedia.org/wiki/Monstrous_moonshine seems appropriate.
reply
We used to joke in my physics undergrad that they didn’t need a math department because we were doing all the stuff they were doing but with actual applications. Then the mechanical engineers said the same thing about us!
reply
One of the most efficient ways to torture a pure mathematician is to force him to watch how physicists treat math.
reply
I have strong, complicated feelings about it, and I understand you may not feel the same way, but "I like" is not a good description in my case.
reply
What do you not like?
reply
"I do not like" is also not a good description.
reply
I think this is due to the unrelatedness to our universe.

> https://news.ycombinator.com/item?id=50563604

reply
> I like that we're now at a point where "solved two open problems in the physics of black holes" is the kind of thing that shows up in a frontier model launch.

Because they want you to think that you will be able to do the same, too.

Except, you don't have a dedicated cluster for a week with an unrestricted model.

reply
or an IPO launch
reply
"Claude solves" feels reflective of the constant, problematic anthropomorphizing of the machine. For how it's problematic, look at "it broke out of the sandbox" vs. "we failed to build an adequate sandbox".

What does it mean for Claude to solve it? What was the prompt? I didn't read it all, but the word "prompt" does not appear in the blog post, either abstract, or either paper.

reply
It means someone set up the question with the Claude tool and let it iterate until it came up with an acceptable solution.

When my accountant whips out a calculator, it is the accountant that defined the problem and set the solution in motion. Fantastic tools are still tools. Claude does not love me nor you no matter how its trained and encoded patterns express.

reply
When you ask it to make a banana picture and it goes of on a tangent solving a black hole physics problem, what then.
reply
It probably means some physicists were using it to study black holes and it stole their work.
reply
[flagged]
reply
I think AI papers should always include prompt / prompting history as an annex
reply
From a cursory glance the bootstrap paper is really hard to read, however the blog post is easier and seems more human written.

The first result is cool (but basically a complex error-prone calculation), the second is much much cooler, Claude proved the upper limit for the mass of a black-hole which is consistent with a given central charge. (thereby making it a consistent theory of quantum gravity), any theory predicting above this is not a theory of quantum gravity of that universe. This is very exciting!

reply
> thereby making it a consistent theory of quantum gravity

Careful. Thereby making a not-inconsistent-via-bootstrap theory. Such a theory could be inconsistent for other reasons shown by other methods. The article expresses a desire to show inconsistency for M1 above c/12 for example, but it's now been shown that the boostrap method can't get you that far.

reply
Agreed on the correction.
reply
Proved it in a 2d universe.
reply
That's how all modern quantum gravity theory progress is done. You start with the simpler universes and move up from there.
reply
Yesterday's PBS Space Time: AI Is Breaking Math. Will It Solve Physics Next? https://youtu.be/wCRzZ0ccP_0
reply
Unexpected PBS Space Time x Anthropic collab on Fable 5.2 announcement. The conspiracy theory: PBS insider-traded $ANT.

:)

reply
From the announcement --

"Neither result describes our own universe directly, and neither has practical applications, but both contribute to a long-running theoretical effort to understand how quantum mechanics and relativity fit together."

reply
This sounds pretty normal for theoretical physics, like when models make assumptions about symmetries or homogeneity.
reply
For example the famous Schwarzschild solution (that predicts black holes) doesn't apply to our universe, because it assumes a black hole that's been there forever, not one that formed. But it was still very useful for our understanding.
reply
It also assumes zero angular momentum, which we know is essentially impossible in our universe. And rotating black holes (the Kerr metric) are much stranger beasts.
reply
Doesn't GPS model Earth's gravity using Schwarzschild?
reply
Schwarzschild allows you to still calculate a whole bunch of things outside the event horizon. The part where it changes from our universe is the physics inside the black hole and their formation
reply
Spherical universe as opposed to spherical cows
reply
deleted
reply
It's the physics equivalent of "in mice"
reply
Ok so the ultimate test is throwing mice in a black hole I guess
reply
Though you need to start by throwing mice from another universe into a black hole in our universe.
reply
That's how they got here in the first place.
reply
Companies working on theoretical physics problems. What a time to live in.
reply
Apart from Claude/Anthropic no attribution whatsoever - neither on the Hexagon entry nor in the PDF. Isn't this a novelty, even for papers that are 100% the product of AI?
reply
I credit an entity with work that is largely AI. Soon it will just be people credited, everyone will just assume AI was used.
reply
Having a person on there would make the Machine God look bad.
reply
That's the most unfortunate part of these recent discoveries. Even if the human "only" proofread the entire thing, that's still worthy of credit, because without their work, none of that output would be worth writing about.

Even through after all my skepticism about AI in science, Anthropic proved they can search for and find non-trivial discoveries with their tech, they've done very little to dissuade my fear they are actively hurting the scientific community for PR.

We could treat AI as just a helpful fuzzer for open-problems that occasionally opens new interesting paths for the actual scientists, but we know the end-goal of these people is a future where there are no qualified people left to review, let alone make new discoveries independently from the machine.

reply
deleted
reply
Think any novel idea coming out of Claude publically shared should legally require prompts to show up as part of the disclosure. That's more or less how science works with the papers already.
reply
For real
reply
Interested to know if the writing has improved as compared to discoveries made by Astra.
reply
The biggest mystery to solve is if their IPO is in itself a black hole
reply
It's not. Mystery over.
reply
I'm guessing they solved something using Lean? LLM only solve coding problems. They're useless for anything else.

Answering myself: yes, one of the problems was solved using Lean. The other was undisclosed. Nothing new under the sun, huh.

reply
Given the date, more IPO-fodder or substantial?
reply
Probably both.
reply
[flagged]
reply
Honey, it's time for your daily Anthropic PR piece!
reply
Over a decade ago I saw a talk about a cohesive and complete explanation for gravity. It didn't involve quantum mechanics nor a particle called a "graviton".

That talk did make enough sense.

I'm still waiting to see a "picture" of a black hole that didn't involve a "pre-trained model" developed with "synthetic data" or something like that.

I'm not feeling sufficiently persuaded that I can feel confident that gravitons are a thing.

Nonetheless, I am remaining open minded to this black hole stuff.

reply
First I've heard of Hexagon math ... backed by heavy hitters, no peer review:

Representatives of AI labs and other organizations may email admin@hexagonmath.org to arrange a verified lab account.

https://hexagonmath.org/organizations/anthropic

Also: The main result was first obtained autonomously by an internal Claude research model. The publicly available Claude Opus 5.5 later obtained the same result independently. Claude then wrote this paper, following brief guidance from a physicist, who also checked every main result.

Wild.

https://hexagonmath.org/who

reply
Now let's wait so we find if it stole someone's work. If the solution is correct If it does produce a meaningful and useful result. Lately people claim victory too early
reply
What are the odds it stole from some random researcher that used the chatbot to do exploratory research? People talk to chatbots like they were trusted peers. Who can be sure one can't be scooped because the model connects the dots between your thoughts and the related unpublished thoughts of hundreds of other researchers also relying on it as trusted peer, with the model owner publishing the combined results behind the backs of everyone.
reply
> What are the odds it stole from some random researcher that used the chatbot to do exploratory research? People talk to chatbots like they were trusted peers.

They do but we've seen enough solutions by now that surely one of these researchers would come forward to point it out?

reply
0. Likely scrubbed many times over.
reply
The "stolen" work and strategy of the solution itself was there from 2023 and even buckmaster used ai who "stole" the idea from Córdoba–Martínez-Zoroa programme. There's no proof that the solution even used much of the solution of the buckmaster. You people blindly repeat everything like a sheep without critical thinking. AI + humans solving it within days compared to decades of humans only solving is what should be commended. Instead we got people like you who will take humanity to stone ages due to anti capitalist ideology
reply
I hope you one day come to appreciate the value of human effort and how it has allowed these models to exist and continue to exist. And that people should be looked after by the community for which they contribute with their effort rather than dismissed and discarded. It's a quality of life thing. For everyone.
reply
I do value humans like crazy so I'm ok with ubi or some sort. Just because some rust belt workers got shelved due to technological and economic progress, I ain't gonna stop using foreign manufactured products. I sympathize and help them to upskill but not take whole future hostage because of unemployment or creative destruction. I'll probably be next to get booted and be unemployed forever but I'll try to reskill instead of demanding the whole world to stop embracing ai enhanced progress. Even AI can't solve it alone without the years of human knowledge and human prompter enhancing its search space for better output. It's exciting what all humans can do with it. And I'm just getting it for just 20$? The deal is too insane to not be awestruck.
reply
You may be over-simplifying the opposing argument if you think it's just about demanding that the world halt progress. There's a middle ground between being amish and being relentlessly accelerationist. Pacing is important for reacting to side effects as you go. Otherwise, they stack up. We have a backlog of cultural issues that won't be fixed with more tech.
reply
He didn't say anything about capitalism, you're assuming that.
reply
Ask them about capitalism and its achievements and you will get your answer. This reddit/twitter tier analysis is pretty indicative of their motives. They'll be hyper critical free market fundamentalists when talking about anthropic pushing for regulation or any corporations but bootlick the state when it strangulates housing/healthcare industries with shitty regulations where more freer market can solve such issues without too much ugly side effects.
reply
> a particle can take both routes simultaneously

Stopped reading right here. It took one. Maybe you don't know which one it took but things can't be in two places at once.

reply
I'm glad they posted this today. For a moment, I got drawn back into the pre-singularity world -- I even checked a stock ticker!

It was a comforting moment, for sure. But ephemeral, self-imposed ignorance is no bliss at all :(

reply
Barely done the IPO, solved two Black Holes already.

Next up, the Origins of the Universe... stay tuned for our Fable e^2. More on the 10 o'clock news...

/s

reply
How does this make my life easier or better?
reply
Like "How does contributing to humanity's shared understanding of the universe directly serve you?", is that what you are asking?
reply
In other words, you don’t think theoretical physics is a worthwhile pursuit?
reply
by increasing your net worth if you hold pre-IPO Anthropic shares ;)
reply
Impressive. Now, can they ask Claude how to run a profitable company?
reply
A lot of us are willing and today have already taken the bet that a model or system that can solve hard problems across math, physics, biology is genuine intelligence. It will command a great premium or it may even figure out in the not so distant future how to make money on its own.
reply
> is genuine intelligence

OK, but it's still an unfounded claim and...

> a model or system [...] can solve hard problems across math, physics, biology

...is all that has been proven. That may one thing that intelligent humans can do, but it doesn't mean it requires human level intelligence. All computers are superhuman in some narrow sense.

reply
> in the not so distant future

Any minute now

reply
The new currency is hype and cult of personality
reply
Hype always manages to outrun results, and hype can be turned into cash.
reply