No, because to advance in a real science you need to conduct real experiments. And it's a lot slower than multiplying matrices on a million GPUs.
Look at LK-99, it felt like a global effort was inspired at the time to verify room temperature superconductivity.
It might not even require a specific lattice structure to be identified - there is still quite a bit we don't understand about regular superconductors, a large breakthrough could materialize RTS's within a year. Producing them at scale is a separate issue.
We already have supercomputers to run simulations like this, and can already spend millions of dollars on compute to answer hard problems. AI may help improve experimental design but this is something humans can already do reasonably well. I’m less optimistic we can derive similar results as we have for math, but I’d love to be wrong.
But also: human physicists mostly act on symbols, too. They take measurements using sensors, which produce a bunch of numbers, that they then tease theories out of. This seems in LLMs' wheelhouse.
That said the stock price juicing counts on you seeing these discoveries and then attempting to extrapolate bespoke frontier models' success in math (which is dubious in terms of methodology and tailored training anyways) and immediately jumping to the conclusion that AGI and huge scientific advances are right around the corner and can have us all living in fully automated luxury Yudkowsky MIRI effective altruist utopia. It's a farce.
And yes, someone is going to comment on this by saying "moving the goalposts, in 2022 models couldn't even do this." Yes, it's incredible how much throwing money at certain logically achievable outcomes helps achieve those outcomes. It is not clear how it helps achieve random wish casting by odd cult-like CEOs, however.
Particles meaning electrons, protons, and neutrons.
Also, for superconductors, QED is sufficient, QCD is used to simulate hadrons, not electrons.
Just because you can search faster for something, it doesn't mean that that something ever existed in the first place.
I think a lot of LLM stuff is just speed-running alchemy. Instead of wasting a lifetime, computers can now waste thousands of lifetimes.
Aren't most of the remaining problems related to nuclear fusion engineering ones? Like building reactor walls that survive neutron damage.
Basically there's no hope even high Tc superconducting tokamaks can be competitive sources of energy.
You might say "but make the magnetic field even larger", but most of the mass of ARC is the steel structure to resist JxB forces, so much further increase in B is not practical. There are also minimum sizes for fusion reactors set by the need for sufficiently thick blankets to stop the neutrons; that's independent of magnetic field.
(If you meant concentrating solar thermal plants, those are also uneconomical.)
Decades of detailed engineering studies of DT fusion reactors (like ARIES) have had them coming in more expensive than fission, as one should expect.
Engineering problems are solved by massive amount of logistics: finding and hiring the right people to be in the right place at the right time with the right tools and raw materials that need to be purchased at a physical location and delivered by cargo ships and trucks driven by truckers across the country. People get injured, sick, go on vacations. Trucks crash sometimes. Cargo ships get delayed. Tools break and need replacement. Materials turn out to be wrong quality or quantity.
This is an entirely different world from software development or math where you can try different solutions and know if they worked or not in a matter of seconds.
so the task for an LLM here is doubly difficult and the feedback loop is of very high latency. I do wonder if someone is trying though. simulate physical process and entropy/annealing -> simulate superconductivity. and very few working examples to work with.
1. Is there a good theory of high temperature super conducting that we can easily simulate? My furthest understanding of this was that BCS was insufficient.
2. Does such a theory impose limits on the temperature that are achievable?
3. Do we know if such a theory is complete in some sense? (e.g. if such a theory predicted no super conducting material at a temp K and pressure P, we would know that there could be no such material at temp K and pressure P based on reasonable assumptions)
A coordinated pause needs to come at the national level
Still waiting for the AI advancements which are not just taking away work from SWEs and mathematicians..
At this point this line of "yeah but what about..." is getting silly. We've had 2 millennium prize problems fall this year, plus a lean proof for FLT (another effort worth 1m$) and people are still "yeah, but what'd be cool is if..."
Dunno, at this point I feel like people are trolling. This is absolutely insane pace, and just last year we were hearing how "there is no more data", "models are stalling" and so on. The negativity and goalpost moving is getting tiring.
I don't see the value and I don't see the world changed.... yet
You could try to be happy for others who see the value.
I'm not saying the technology isn't amazing. It's completely surreal how amazing it is. I just wish it did better things.
(Yes, yes, I know it's Fermat's Last Theorem)
"Taking away work from SWEs" means enabling everyone else (or even SWEs) to do things they couldn't do before. This is obviously an improvement.
If I could justify enough tokens, I'd point an agent at my harddrive and tell it to formalise all of my old notes and goals, and spin up agents to build all of the things I've made notes about that I would like to exist. It'd still likely take years...
I just kicked off Kimi building a game based on a concept I had kicking around. I wouldn't have time to build the game or even write the spec, but I had time to type "write a game based on [paste of the concept]" to see what falls out of it.
I can't imagine ever running out of things I want, because every thing I finish tends to result in my todo list growing with new things.
You wont see whole sale replacement but you will see doing more with less.
Yeah, I want the cure for cancer yesterday as well, who doesn't? This is the most significant result in mathematics in over a century.
People are scared.
To be clear, I'm just disappointed and sad that AI mainly takes our jobs (or at least the satisfying part of it) and solves mathematics without increasing our understanding. You know, the part that's the main point.
However, if in exchange it solved, say, climate change or fusion, that I would happily accept. No sign of that so far.
Maybe you are a well off rich kid or just cashed enough from faangs to be set for life, whatever. Is it really that challenging to muster some empathy to those who, upon seeing their profession disappear with 0 replacement in sight, are scared of the future since they don't know how they will even feed their kids, not even going into higher expectations of life?
At the end some math understanding is secondary at best when facing existential threats.
Trend lines are a thing and progress does not happen overnight
[1] Not to get too religious about it, limitations still exist
Also, your analogue is off. If you had a bread and fish machine that made bakers and fishermen unemployed, while only producing bread and fish for the top 1%, I would not be very happy about it.
In anticipation of a followup, "can I wish for it to solve climate change advocacy for us?" It can provide research direction on nearly any topic but as soon as we are talking about actions in the real-world it requires more than purely intellectual output.
Anthropic and OpenAI make their models available to anyone for use. I call up cornucopias of bread and fish daily and you have the power to do this too.
> Still waiting for the AI advancements which are not just taking away work from SWEs and mathematicians..
100% wrong, if a 95% efficient solar panel could be produced really cheaply, it would be solved. If fusion power could be created, it would be solved.
[laughing_greta.gif] they still do that? :DD
No, we don't get useful things.
I don't know about room temp superconductors, but fusion has gotten a bunch of investment recently that make it seem like it'll happen before I die.
Specifically, REBCO superconductors are in production by Commonwealth Fusion Systems to make SPARC, targeting net fusion gain for 2027 with a tokamak design.
The NIF has been able to achieve ignition, repeatedly.
Whatever you want to call it, AI/ML/GPUs; point is, supercomputers today are insanely powerful for running plasma control simulations and software.
Commercial contracts for fusion are in place.
More interestingly, Marathon Fusion has figured out a way to generate money instead of energy which needs to get sold off at energy rates. Fusion moves subatomic particles around. Instead of generating power with it, they're going to use the technology to transmute elements. Like alchemists of yore. Just, like, with science and it actually working. They estimate they can make money from converting mercury into gold, but more lucrative is radium into actinium, and zinc into copper. Specific isotopes of those are used in the medical industry to help fight cancer and are very expensive.
That's more of an economic technology than a technical one, but money is always the issue, and if they're able to make money with their scheme, that money can be used to fund further fusion research.
Maybe not next year, but some time before I die, fusion power seems entirely possible!
That’s child’s play. I wonder if we’ll have star trek replicator by next year.
That's a walk in the park. I wonder if we'll be sipping life juice in comfy matrix cells by next year.
Tell me you've not worked in hardware engineering without telling me you've not worked in hardware engineering
Yesterday I built a whole new system for agent-human PCB co-design (skidl+kicad). Maybe you don’t feel it yet but massive hardware speedups of the same OOM as swe and math are very clearly on the horizon now. I mean right now on the front page there’s a new agent swarm designed CPU claiming massive performance improvements.
Key word is "claiming" and there are plenty of comments on that thread pointing out that the supposed new design is actually just a very old design that was disgarded for practical reasons that are still not addressed and appear to have been hand-waved away.
So you might want to check yourself since it's already helping massively in hardware.
>we
Luckily, this matter does not pertain to the permanent underclass at all.