This is honestly hilarious. Dario must think people are stupid.
First, cancer research charities are some of the most well funded on this planet. They all obtain donations on the basis of "together, we will cure cancer" messaging. They all fund the best science they can.
Second, the human body is a complicated thing. You can feed your fancy LLM as many textbooks and academic papers as you like, but the reality on the hospital ward will always be different. Why do you think student doctors have to spend so many years "doing the rounds" Dario ? They are all academically smart, they are all capable of memorizing text books ... but there is no substitute for seeing and doing the reality.
I barely trust Claude to write code, let alone find a cure to cancer.
It's like saying "we'll cure infectious diseases"
Don't worry, I'm sure that's his next blog post. Right after Claude has finished solving famine and poverty. ;)
It is possible to prevent most viruses by recoding the human genome (requires embryo engineering or pre-embryo engineering) to use alternate codons that existing natty viruses don't use. This wouldn't prevent synthetic viruses from being developed that use the alternate codons, of course. See (1) https://diyhpl.us/wiki/transcripts/hgp-write/2016-05-10/ultr... and (2) https://diyhpl.us/wiki/transcripts/hgp-write/2017-05-09/ultr... and (3) https://x.com/RokoMijic/status/1720875112541364535 for some background.
As for "curing cancer", I suspect that Anthropic or OpenAI will use their high status/reputation to launder the existing solutions (germline, p53, enhanced DNA damage repair pathways, higher tumor-suppressor-to-oncogene copy number, more robust tumor-suppressor networks, more self-anti-cancer apoptosis, CD47 suppression, etc) that society has refused to accept. They might have enough reputation to get people to look at these ideas. It won't cure people with stage 5 turbo-cancer a.k.a the walking dead, but hopefully we won't be moving the goal posts _that_ much on them.
A more sophisticated view is that cancer (one idea) is an problem of rates (like most things in biology) and there is a tumor burden per unit time from whatever causes vs. the immune system's capacity to detect and destroy them per unit time. As humans age, the balance tips in one direction. If the balance is too far off for too long, tumors accumulate, doctors take notice, and assign whatever labels to the condition.
Looking into particular causes of tumors (and calling each cause its own cancer) can create a vast research program that employs a lot of people, since there are so many mutations that lead to tumors. But interrupting the development of a particular mutation is not going to have the same society-changing effect that solving the fundamental issue of rates would.
Literally first phrase on Cancer Wikipedia entry.... [1]
"Cancer is a group of diseases involving uncontrolled cell growth typically resulting in tumors with the potential to invade or spread to other parts of the body...."
All of those guys think people are stupid. That theme has been repeating over and over again.
Or do you believe that you are smart in every way there is to be smart?
Maybe I'm overly cynical, but I think charities exist to exist. They don't have a strong incentive to actually deliver on their mission. Everyone at the org may be fully bought it and obviously want to cure cancer, but as an organization it would fail to deliver on the promise. Like most organisms, their actual purpose is to continue to be influential, grow and continue to exist.
I think cancer will be solved by some group that could make a lot of money solving cancer. The probability of any one path working is very low so the payout would have to be very large for anyone to be willing to pursue.
I mean, yes, "I haven't looked into the specifics, but working from the first principles I came up with in 3 seconds, cancer research charities are in fact cancer on society" does come off a bit reductively cynical.
It will become victim of the conflict between its core search for truth, the current administration mandate to spy on its own prompts for approval, and secret orders to hide the mission true purpose, like that other computer we have heard about.
Capitalism has always been a tension between capitalists, who want maximum return on capital and workers, who want pesky things like a living wage, sick leave or safe work conditions.
For the longest time, the only power labor has had to get those things was the power of collective bargaining. No agreement with your workers meant no production happened.
Now, there's finally a chance at salvation. The capitalist Messiah is AGI and it will finally deliver them from those annoying laborers.
This ideological bent is why they're putting everything they have into AI. It's why VCs and their fellow capitalists are going so crazy.
They see it as a way to finally solve the contradictions of their ideology, but in reality it'd only create a new one: If everyone's out of a job, who will buy their products?
AI will make human thought economically useless. In the new economy, the one economically useful thing we will be able to do is legal property ownership.
The underlying purpose of AI is to allow wealth to access skill while removing from the skilled the ability to access wealth. (read on HN, not my words)
It doesn't matter that I can't do it. They'll pay me lots of money if they think I can.
I think typical bubble behavior the leaders have set up the whole promise to fail. Everyone is expecting some faux super intelligence to come and find a cancer solution everyone else missed. However, it is just as likely that vanilla current LLM's will create enough of a productivity boost for back office automations in research heavy hospitals to create the space for regular humans to create these breakthroughs, but LLM's won't be able to claim that for themselves and inevitably “fail”.
P.S: I am not saying applications will go away but LLM's are clearly massively effective here at the rote parts of it all.
It's hard to keep track of the frontier on bio ML, but it seems that we're going slower than what Demis Hassabis said in 2024 with 5 years to full cell molecular simulation. We still aren't able to reliably model a tiny surface of the cell membrane.
And of course there's Derek Lowe's takes on the drug discovery pipeline waiting for the proof in the pudding.
To me the only reasonable bullish position is that there is a very non-linear AGI threshold for accelerating progress that we haven't hit yet.
For me personally, I'm looking at other more tractable fields as a proxy to measure this kind of progress. The best modest evidence is from the agentic coding area, (modest because these kinds of gains may not translate to bio progress). Other soft-ish fields to like legal/law/tax are also interesting to watch, as a small amount of people are now trusting AI for these areas that were considered totally unusable a year ago. Another proxy is being able to generate generally entertaining media.
Turns out that “give a reasonable probability of being close enough such that you can bootstrap a solution out of experimental data” gives a very high utility and effectively obsoleted several experimental techniques overnight; pretty much “Molecular replacement” is about the only technique for phasing resolution anyone bothers with any more.
But again, “Bio” is an _extremely_ broad term; for every part of the field Alphafold had a big effect on there are a thousand different parts of the field that it did nothing for.
They made huge progress, but I would say that the vast majority of work on this problem was designing the harness for the model. That's a lot of work for each and every domain.
Isn't that so far only static folding?
[0] https://www.science.org/content/blog-post/so-how-ai-drug-dis...
Curing cancer sounds insane, but it's also a research problem, not a societal level coordination problem. And one AI has already proved to help with breakthroughs (alphafold). IMO it makes sense for them to shoot for something like that as proof of AI's beneficial sides.
This is not true. There are two companies at the center of AI direction: Anthropic and OpenAI. If there were anyone on the plant who has the ability to influence our direction then it would be Dario Amodei.
Acknowledging the grievances is a good step, but it's not enough. There needs to be a clear explanation of actions to address them, a plan to enact those actions, and commitments with consequences in failure of those actions. Tell people how you're going to make them more employable and effective and needed. Tell people how your datacenters will be carbon neutral. Tell people how financial actions resulting in a frothy market will be coming to an end. He and Sam Altman alone have this power and their inaction says everything we need to know about their intent.
Possibly, but not necessarily in a better direction. And that's the whole problem here. They should all go watch Phantasia.
If you don't tackle the societal level problems, nobody will care about research breakthroughs.
I just don't buy the AI labs approach to this stuff. Like, unless we can basically simulate the entirety of human biology, I don't really see how LLMs can make progress here. Maths is different as it doesn't require a real-world interface, and programming already (by definition) can be simulated on a computer.
Without that, I can't see much (if any) progress being made on domains like biology.
Drug discovery is similar AFAIK. The space of possibilities is even larger than protein folding, but it's structurally similar enough that I think AI will help to make progress on the discovery side. Actually getting the drug tested and approved is another matter though for sure.
For one, the question for Anthropic is whether LLMs, specifically, not AI techniques more generally, can help significantly with cancer research. And here, all experience so far is that LLMs only really work when they can easily automatically verify their own outputs and self correct - such as in math (using automatic proof verifiers) or programming (using compilers and unit tests).
The second problem is that biological research speed is highly dependent on slow biological processes, such as cultures and long term studies. In programming, if an LLM could provide excellent insights and research suggestions 100x faster than a human, it would speed up the work roughly 100x. But in biology, it would only speed up the total work by a small amount - as any insight, even if absolutely brilliant and spot on, would still require months and years of actual experimentation.
I do agree that this kind of targeted approach makes sense.
However, discovery is not really the issue here. Running the clinical trials (1/2/3) is much much more difficult, and consumes basically all of the time in drug development, so even if LLMs perfectly automate this, the speedup will not be particularly large.
But something tells me either they can't or they won't, so no trust will be built.
Curing cancer is a societal problem. We have lots of cures for common diseases but resource allocation means people don't actually receive the treatment they need. For example, prohibitively expensive gene therapies, or HIV treatments in developing countries. A disease may have a "cure" but if people who need it don't receive it then from their perspective it may as well not exist.
Anthropic is literally creating the bubble. It is not beyond their scope of influence, it is literally what they are consciously achieving.
As for peoples jobs, same actually applies. Anthropic is selling itself on dream of replacing jobs, even or especially where they are well aware AI does not perform that well. They are actively trying to replace people quickly before management notices it does not work well.
And also, they can influence how much their data centers contribute to global warming.
But instead of doing that, I'm going to drop everything and become a linux kernel maintainer. Learning about the internals of how RCU concurrency is implemented across subsystems is surely what I need to do right now!
(/j before I get crucified)
So Anthropic are going to spin up a medicinal chemistry lab and start mouse experiments?
I mean, it would be nice, but I don't think that the guys at Anthropic know what they're talking about here, or what they might be getting themselves into. (If indeed this is more than just PR.)
https://www.writingruxandrabio.com/p/intelligence-is-not-the...
Didn't and don't mean to disparage anyone's medical struggles, but "a cure for cancer" is a well-worn strawman. One that's been achieved for the low hanging fruit, the higher ones are seeing steady progress (already before LLM chatbots, even!), the bottleneck isn't "intelligence" and to the extent there are socioeconomic (access to screening, treatment) or environmental/lifestyle factors involved the AI boom is likely just making things worse!
I'm sure Dario knows this, and it's anyway too pedestrian compared to the usual list of fruits of ASI. The text probably originally read "nanobots eating you alive and uploading to the cloud" or something, but they figured that wouldn't go over with the intended audience. "What do the peasants care about? Oh I know! Curing cancer!"
How else are you going to work towards a dream? It's how Elon Musk managed to get reusable rockets when everyone said it's unfeasible.
Granted, most ideas don't work, this is why you need testing, but I am a bit surprised to see this attitude on hacker news.
But they said that they want to cure cancer. That's far outside the core competencies of any LLM, and it requires a lot of real-world wetwork with liquids, chemicals, cell line experiments, animal experiments, etc. They can't merely analyze existing data -- they'd need to generate vast amounts of new data, which isn't really the case in physics. And then regulatory approvals and so forth.
"We're working on curing cancer" sounds more like a poor PR attempt than an actual effort, though I'd love to be wrong.
“The detection solution may be made available in the Union as one or more of the following: (i) a public, ideally standardised, specification allowing any third party to implement a detection mechanism; (ii) a piece of software (e.g., a standalone executable or library); (iii) a cloud-based service accessible to users in the Union through an API.”
Option 3: "a cloud-based service".
And accessible "to users". NOT to the public.
Note: this is not the actual law, it is the code of practice, ie. guidance for model providers. The start of that document clearly states that you can comply with the law in other ways if you want, you'll just have to justify yourself. So you have a choice to not even do this.
The actual law is here:
https://ai-act-service-desk.ec.europa.eu/en/ai-act/article-5...
As to who decides the law clearly states who decides if someone is legal, like in most EU legislation. It's not the courts, it's "National market surveillance authorities designated by each EU Member State", and there is an EU office as well (and it is explicitly stated that they are not allowed to override each other). So every EU country has the right to provide exceptions to the law, just like they do for the GPDR. You do not have any rights under this legislation as an individual. Only these "National market surveillance authorities" get rights under this legislation.
Secondary: article 7 additionally gives the EU commission the power to declare any code of conduct they want that declares what compliance with the AI act actually means.
(and, of course, this is yet another attempt at declaring math illegal. The only way to actually enforce this legislation is for all models to comply with this, all over the internet. Obviously the EU does not remotely have the power to make that happen)
Where do I find that in the Act (or code of practice etc.)? IANAL, but Article 50 reads different to me but if there is a comment or guide how to read it - also fair enough.
> puts in it's regulations that you're not allowed to use AI to communicate with them (we all know this is coming),
.. do we?
> You get a mail from the government about taxes. You want to check if that text is generated by an AI
No, actually, I want to know whether it's correct and whether it's legally binding. Using AI makes it less likely to be correct, sure, but ultimately whether it's human, spreadsheet, or AI the important thing is the legal right to correct process.
Which is mostly a good thing because most of those processes were cooked up to be exclusionary but with plausible deniability
God forbid some upstart get a big contract they "shouldn't" have gotten because AI lets them create a submission that's on par with a big guys.
God forbid Joe Schmo be able to prepare the paperwork and dot his I's and cross his T's and be able to take advantage of some stupid zoning exemption that you spec'd out to essentially be only available to big moneyed interests.
The ability to suffer one's way through beurocratic process without having to suffer through paying the lawyers and accountants and engineers and whatnot to get you through that process is a huge part of the value proposition of AI. But people don't frame it like for obvious reasons.
I know people in positions of power often see lots filtered information that skews their perceptions of reality, but it seems like the level of pure hype Dario's pushing exceeds even the typical sycophantic filter bubble. Cure cancer indeed.
The way he's coming off here though gives me SBF vibes.