Biology is the complete opposite of that.
Despite the improvements, though, we still see plenty of code that is "slop", because it's directed by someone with little idea of what to do, but also because it's harder to test for (or even measure) code quality than correctness. The "solved problem" rhetoric depends very strongly on your standards.
In other fields the problem is similar, and typically worse. Plenty of AI music sounds acceptable, not clearly flawed, and even mildly "interesting" to me; but I think this is much more a commentary on music than it is on AI. Prose continues to be abhorrent in nearly every application; while I've seen examples of people getting really impressive output, it takes a level of effort that defeats the purpose of almost everyone who wants AI to assist their writing (i.e., just generate a comprehensible report on some findings and get on with their day). Art is a whole different world; the quality of results clearly strongly depends on the quality of prompting, it's much better/worse in some genres than others, humans vary widely in their ability to notice "mistakes", etc.
For instance, let's say we are doing biology on plants, which is still much easier than doing human trials. No matter how motivated claude might get, you aren't getting a corn plant to grow in 40 seconds. Real world research pipelines involve stages where even greenhouses don't do, and sacks of grain are shipped to Hawaii, or Brazil, or wherever, to try to get practical data for a given test.
If your computer simulation is so accurate you can skip a step now done with biology, great, but it gets harder the larger your problem is. I might see if a molecule kills bacteria kind of quickly, but what does a molecule do to a real human being? Not so easy.
Seeing tiny stuff doesn't magically give you enough info for Claude to reason with the system predictably (the way it can with source code).
There’s no well-labeled dataset for all this because we don’t know everything we are looking at.
Take a neuron. You can stain it so you can tell apart an axon and a dendrite. But if you don’t it’s very possible to miss or mislabel the axon, because unlike the textbook neuron, the axon isn’t always obviously oriented in a way that promotes ID.
And that’s just one example. With more complex samples, you also have a lot of edges which AI models don’t segment very well.
So, I'd say it's a pretty similar process, and yet we have the AI models now almost completely integrated into the SWE domain remediating significant parts of its complexity.
AI already can do in-silico simulation
add microscopes and tiny precision actuators, and we can build closed feedback loop in-vitro system
once we have in-vitro, it will be easier to go in-vivo
I've always thought openai could actually create an agent that can control various physical robotic arms and things like that, and then continuously iterate on solutions that can participate in the real physical environment. This could accelerate automatic iteration for many things that require human operations, such as complicated experiments, assembly adjustments, and testing.
Otherwise, AI is always trapped in virtual systems and still needs human intervention. But even though AI is already very powerful now, there is still a limit to how much humans can handle or assign tasks. Many times, AI has already finished processing something, but I don't even have time to assign the next deeper level of tasks.
People hope AI can improve productivity, but at the same time they're afraid of AI actually getting involved in reality, while the valuation of the entire AI industry is so high.
This kind of wanting to move forward but not moving forward makes humans especially uncomfortable.
finally, us
Since sequential steps are slow, I think we're going to see massive increases in parallelization. I'm not sure how the regulatory frameworks will keep up honestly.
Why? This is not an AI problem, it's an industry one. And if it was simple, it would already exist.
Let me guess. You have never stepped in a lab.
Not necessarily. Many things are simply gatekept behind the door.
We see it happening in SWE as we speak - people from and outside the tech who had no or very little experience with programming are now starting to deliver their ideas into products without devs or very few of them. We also see this within the SWE where strong domain experts are now able to deliver ideas into code easier than ever, and by themselves, and for which they would previously need a handful of programming experts. We also see it in other way too, strong programming experts are now able to pick up other domain easier than ever.
This process is something that I believe it will (and hope so) inevitably be picked up by the pharma too so the myth about the complexity will become broken.
Process improvements come from failing faster, so you spend less money on your test. Finding the actual answer without testing would also be wonderful, but LLMs might be fast, but they aren't magic. Something like Alphafold saves time in some steps, but it's not just "hand me a candidate", but find completely novel verification mechanisms, which would be just as useful for humans. Either way, parallelization is unlikely to increase.
I wonder what the unlock would be, if any, of having simulations substitute any (or all, in time) of these steps. Akin to the method used to train FSD cars, or robots.-
But I'm no biologist so if someone else is, feel free to correct me.
I wonder if, at some point, AI's will perform to such degree they are able to construct "black box" simulations as needed, that nobody understands BUT that are sufficient to empirically experiment on ...
... much in the same way LLM's function now: In an aggregate sense, they are bloack boxes.-