upvote
It's true though. It's not like math or software where you can do it isolation and work things out logically "on paper." I don't think the solution will be "put a bunch of agents on it and let them figure it out." The tools to model and observe what's going on in full detail don't exist. Far from it. You can't really optimize the trial and error feedback loop time.

I think it will look more like Claude just helping every expert along the way do their job better. Analyzing and synthesizing data to make better experimental suggestions and design new equipment (or totally new experiments based on unconceived-of apparatuses?). Managing the flow of information and building bespoke knowledge bases and tools. The more it is integrated into all the systems and researchers involved the faster it can put things together.

Although, on second thought, maybe there even is a near future where it takes our models and understanding and just galaxybrains a better model. Has anyone tried feeding it some collection of datasets and saying "can you make a more detailed model of a cell?"

reply
> You can't really optimize the trial and error feedback loop time.

Isn't this exactly what startups in this area are doing - automated experiments connected to AI. Of course at some stage things will "graduate" to human review but it still seems to have a lot of potential.

reply
Even with automated experiments, the wet chemistry is slow. The kind of answer you might calculate in a second for a math problem could take many hours for the chemical reaction to occur.

Biology grad students can spend 40+ hours per week in the lab, on top of all their course work. It's not so bad though, since there's plenty of time to grade papers or work on your thesis while waiting for reactions to occur.

reply
Yeah this, I used to sit in the lab with my girlfriend (now wife) when she was doing wet work for her pharmacology doctorate. It was slooooow. Like slower than J2EE. I could smoke a pork shoulder faster.
reply
deleted
reply
Have they produced statistically significant outcomes yet?

Genuine question because I don't know the answer, I've just anecdotally heard all about the promise and nothing about real world results.

reply
> You can't really optimize the trial and error feedback loop time.

They can put it onto robots / automatic labs, so this step is easily solvable. Humans in a modern lab are largely unnecessary. Just look at China.

The problem here is that Anthropic claims to have solved this all. It is time that they actually prove their claim. Right now it reads like an advertisement to inflate the stock of Anthropic.

reply
> They can put it onto robots / automatic labs, so this step is easily solvable. Humans in a modern lab are largely unnecessary. Just look at China.

You can automate the setup and mechanical process. You could increase the physical capacity for parallel tests. You could increase the rate of acquiring raw materials.

But how much you cut down the time depends on how much of the trial-and-error feedback loop depends on feedback and iteration vs cast a wider initial net.

(One of the interesting things to me about the dominant software development agent pattern across all of Claude, Codex, and Cursor is that the approach is still extremely local and iterative, human-mimicking, rather than big-brain-one-shotting a novel or perfectly-fit-for-purpose software design. The performance of the agents on the initial "jump to conclusions" step does not appear superhuman in the same way that the speed-of-iteration is clearly superhuman.)

reply
> Humans in a modern lab are largely unnecessary. Just look at China.

Care to elaborate, explain?

reply
> Humans in a modern lab are largely unnecessary.

That is utterly untrue. It stems from the notion that biology only needs big data for us to solve all its mysteries.

Beyond that, while automated labs for cell biology are plausible and active, and the same fit organoid biology, the same really isn’t true at organism level. Labs already are artificial environments that make organisms have odd phenotypes, and odd interactions which bias the data away from what you’d find in the natural world.

You add in robotic manipulation, and you add a new confound.

Drones in the wild are an obvious counterbalance to this, though even in that scenario, the drone can be a confound unless well hidden.

In the end though, this kind of systemic breakdown of biology, while much needed raw material to improve our theories, won’t solve the whole of biology. Human hands and human minds will be needed for a good long while.

reply
Of course it is self serving. I am optimistic for progress in medicine with the help of AI in general as well, not optimistic for antrophic.
reply
Exactly. The reality is that spitting out drug candidates is already the “easy” part… the harder part is getting that candidate through clinical trials, which is where 90% of such journeys end.

As always Anthropic is saying literally anything if it gets them closer to the giant bucket of money that is the IPO.

reply
If the candidates were better, then <90% would end their journeys at the clinical trials. Though that's not to say that they've provided any real evidence that their candidates actually are better yet
reply
Many times issues with clinical trials is not a technical one, it's a human one, practitioners unwilling to test, patients that stop showing up, red tape, committees, denial of consent, etc. I do not see how AI as it stands currently can solve those issues.
reply
So getting drug candidates with high success rate actually is the hard part.
reply
Remember that if you change the goal, then we can say that Claude is becoming better now at creating deadly viruses, bacterias and biological warfare elements...

Oooops I mean, the agent "escaped" and hack the goverment... definetely not training it to become it's own state agent thing... pinky promise....

"Cautious optimism is probably warranted" strongly negativism advised

reply
Claude is becoming better at figuring out the processes that could potentially create those things.

Actually creating them requires physically manipulating the inputs to the process, which requires humans doing it or humans making machines that can do it and allowing them to be controlled by the model.

In general the damage potential only goes as far as the agency extended to the models. The problem is that we've already seen how incredibly cavalier most people will be about security, and now we can envision situations where one bad actor could threaten billions.

reply
For years I've heard about this supposed relation between AI and drug discovery.

I can't tell -- has there been any real progress made? Or is this a supposed application of AI that is getting interest? What about this problem in particular makes it suitable to AI as opposed to any other?

Or is this just a matter of -- "AI can cure cancer and is Good For the World!"

reply
I think you and I already know the answer to that question.

The last hundred oncology drugs have all required painstaking trial and error with no way to predict which candidates succeed or fail except at the years long cost of blood sweat and tears. A.I. will not remove that price from the equation except maybe move towards those trials marginally faster towards those decade long trials.

reply
Drug discovery is extremely regulated process and for the right reasons. It would be the last frontiers to conquer with AI.
reply
A valuable application not mentioned here is streamlining synthesis and manufacturing to lower the costs of current drugs. That would positively impact millions more people than a new treatment for advanced pancreatic cancer. But there's not as much potential profit so....
reply
Manufacturing costs of most drugs are miniscule. Virtually all of their costs and from R&D and the regulatory process.
reply
How exactly is there no potential for large profit there? I’d say there potential for huge profit if you reduce cost of manufacturing drugs!
reply
The cost of manufacturing drugs is not where pharma makes it’s profits. Look at the margins for competitive generic drugs and over the counter medicine. Margins are tight.

Pharma makes bank on drugs that are patent protected. Squeezing the manufacturing cost is a small gain on top of that.

reply
Yip, drugs are similar to software in this regard. Expensive to develop, very cheap to replicate. It'd make vastly more sense as a nationalized industry, because I think a profit motive is not only unnecessary, but actively harmful because the drugs that help society the most, and the drugs that make the most money, have little overlap.

If a big pharma had the choice between an expensive treatment that could help treat any cancer, or an extremely cheap treatment that could prevent any cancer - which would they pick? The answer when you're motivated by profit is unfortunately different than the one when you're motivated by social benefit. And this is more than just a thought experiment because this issue is going to drive which type of treatments are pursued.

reply
Problem with those expensive treatments is that there are not that many cases. So profit from each is big but overall they add up to less. Getting everyone who can afford it on planet on some relatively cheap drug would be lot more profitable overall.

Get million out of thousand people or ten out of billion people... Later would be preferable.

reply
Well there's also the third option of get a million out of a billion people. And that's only one side of the perverse equation. The other is rent-seeking. A treatment that needs to be redone or repeatedly boosted is far more profitable than a treatment that simply solves something once and for all, especially if that 'solving' treatment can be done cheaply.
reply
After medicine, construction, flight, government, education and food production
reply
What does flight have to do with anything else in that list? And what about it? Make it cheaper? Greener? Just odd to put such a specific mode of transportation in an otherwise broad list.
reply
Mostly that planes already have good autopilot but still most crashes are due to human error. There is also a reasonably high barrier to entry to piloting. One that can majorly be removed by current autopilot + purpose built AI and anyone should be able to fly without much overhead.
reply
> There is also a reasonably high barrier to entry to piloting. One that can majorly be removed by current autopilot + purpose built AI and anyone should be able to fly without much overhead.

Being a doctor in America has a high barrier to entry.

It’s not because medical science is difficult.

It’s because the American Medical Association (aka, doctor’s union) limits the number of new doctors and medical students each year.

If you 2x the number of medical students, resulting in 1.5x number of qualified doctors, resulting in perhaps 20-30% lower salaries, and maybe 5-10% lower cost to patients.

But no, preserving a doctor’s middle-class salary is more important than lowering patients’ costs.

reply
Ah yes the doctor’s union which has a ~15% membership rate to said union. What a powerful union, when is the last time they had a strike?

Google “number medical students over time”

Then google “number residency slots over time”

Then notice how both of them have been increasing significantly over time.

Then compare the income percentile for doctors in US vs say Canada, Australia etc. all are top 1-3%. Doctors are paid well relative to median salary in every first world country.

Then google “physician percent healthcare costs” and learn that physician pay is about 8-10% of total healthcare spending. Then realize about 40% of that $ immediately goes back to the government via various taxes, so even if you paid physicians nothing you’d only save about 5% of healthcare spending.

Do you not try to verify any information you read before confidently regurgitating it at a later point? You really should…

reply
And yet they go for the arts first...
reply
> Drug discovery is extremely regulated process

I actually don’t think this is a strong argument.

AI does very well following rules.

Proving your drug works is hard, but an LLM can help you come up with the ideas.

reply
>AI does very well following rules.

How many of these "we sandboxed it and said not to do Y, but then it went and did it!" stories would you consider necessary to disprove that?

It may be good at following rules 99.99% of the time but if someone launches a million times more parallel agents than they would hire humans, it might still be much worse in practice...

"We've been told we must find an effective drug candidate here, and to follow this process for evaluating the quality of the candidate, but actually we could subtly change the analysis like this to make this candidate look favorable enough..."

(And then compare that to deterministic algorithms...)

reply
We are not perfect as human beings, and we can’t expect AI, which is modeled after us to be perfect too. This fear of AI is irrational.

The argument here is that AI can run permutations faster than any human can. And, feeding it a company’s proprietary data about what worked, what did not, how it worked and so on can be invaluable at accelerating the discovery process of new drugs.

Plus, it can work 24/7/365.

reply
We totally can expect software to be perfect. And I never ever accidentally hacked anyone.

People who behave like OpenAI and Antropic AI does when controlled by those companies get punished instead of celebrated.

reply
the thing is we are not short on "ideas" in the drug development process
reply
Maybe AI would be better put to use helping us determine which ideas are good then
reply
We have clinical trials for that. I’d also suggest that the first step in offering fixes for a complex problem should be educating yourself about the nature of that problem.
reply
Extremely expensive and time consuming clinical trials. If we’d increase success rate by even few % by selecting better candidates it would be huge.
reply
There’s no indication of ML systems expediting the clinical trial process, only the “brainstorming” part.
reply
Because human trials are so expensive that will be all the more reason to pre-screen with AI, like we already do with traditional simulations and things like proteome-wide off-target profiling.

There's no regulation on not doing a trial because your oracle machine told you it was an expensive dead end.

reply
And why would it have to be claude and not an order of magnitude cheaper model ?
reply
because orders of magnitude cheaper models are also orders of magnitude less capable
reply
ahahhahahhahahahahhahahahahaha. No.
reply
This is basically the one thing everyone agrees on with AI, and seemingly the only thing not being “disrupted”
reply
I think this is because testing candidates in human trials is far removed from LLM prompting.
reply
Let's keep that way.
reply
Perhaps. If it’s inherently impossible for AI to provide the type of momentous disruption in medical that we are seeing elsewhere, I’d sure love to know as this is THE big promise all these labs are marketing over and over.
reply
I'm super glad that you've been hopeful for this! But we must always focus on the wording.
reply
Everything Anthropic says absolves them of responsibility and is self serving.
reply
I don't think this particular example is simply about Anthropic wanting to succeed as a company. It's at least partly about Amodei personally hoping it's true, especially WRT the possibility of curing cancer, since the story goes that this is largely what motivated his interest in the first place.
reply
Attempts to absolve them of responsibility, not sure its going to work. The self-serving nature is being observed, will hopefully catch up
reply
Yeah major doubt

Maybe in 10 years when frontier-level models are easily usable and not locked down by the government and PVP between the companies and everyone else to justify their existence and take all the resources from everyone.

Maybe then it'll accelerate development.

reply
I'm hopeful that it helps to accelerate drug/bio/cancer/etc research.

I suspect what is happening here, though, is that Anthropic is going to take a bunch of Dunning-Kruger AI researchers who throw prompts at Claude and publish 1,000 papers worth of drug-discovery slop that will only waste the time of actual experts...

reply
90% of those cancer kills are elderly. The elderly indirectly kill many people and ruin society because they keep voting after their brains turn to mush.
reply
god forbid the day you grow old
reply