upvote
Not my area of expertise but I do work in scientific computing. I know that we can do simulations like this for meta materials, where to some extent you just have a really large search space that is not bridged by logic but by brute force, possibly aided by feedback from physical experiments. Assuming we have similar for semiconductors, it’s not clear to me where AI clears the compute bottleneck.

We already have supercomputers to run simulations like this, and can already spend millions of dollars on compute to answer hard problems. AI may help improve experimental design but this is something humans can already do reasonably well. I’m less optimistic we can derive similar results as we have for math, but I’d love to be wrong.

reply
Math is easier because it's text and symbols only. In physics experiments you have non-textual input and this is not the LLM stuff for now.
reply
LLMs are already multimodal, though? Plenty support native image inputs for instance.

But also: human physicists mostly act on symbols, too. They take measurements using sensors, which produce a bunch of numbers, that they then tease theories out of. This seems in LLMs' wheelhouse.

reply
This is what people seem to be missing when they extrapolate all LLM mathematical brute force discoveries to any X or Y scientific problem. Most real-world stuff is not as cut and dry as formal logic and math. Computer science is applied mathematics and almost all logic-based, it follows that LLMs would be good at this. Lot harder to model proteins or materials science this way.

That said the stock price juicing counts on you seeing these discoveries and then attempting to extrapolate bespoke frontier models' success in math (which is dubious in terms of methodology and tailored training anyways) and immediately jumping to the conclusion that AGI and huge scientific advances are right around the corner and can have us all living in fully automated luxury Yudkowsky MIRI effective altruist utopia. It's a farce.

And yes, someone is going to comment on this by saying "moving the goalposts, in 2022 models couldn't even do this." Yes, it's incredible how much throwing money at certain logically achievable outcomes helps achieve those outcomes. It is not clear how it helps achieve random wish casting by odd cult-like CEOs, however.

reply
but what if AI notices a higher order pattern that we humans with our measly cognition doesn't?
reply
I’m sure LLMs can and will help with physics research. I’m much less sure you can frame most physics problems in a way that will succumb to 10,000 agents running in parallel.
reply
This optimistic forecast is based on an assumption that we already know everything necessary to find a room temperature superconductor, so an LLM just needs to connect the dots.
reply