The folks who actually go work in the field, understand the structural problems, the costs/benefits, and the long slog to bring successful treatments to patients are skeptical. But we're still more than happy to be proved wrong- if Anthropic (more than OpenAI) is working on life sciences and drops some amazing information that transforms cancer care with massive positive results, we all win.
Do we all? Or does anyone with enough money to pay for Anthropic's IP, win? Nothing states that Anthropic/OpenAI/... have to share information they have generated. As the crunch for income becomes real, I doubt valuable things will remain free.
If they succeeded, you can bet everybody else will be duplicating their results within 2-3 years.
Doctors might do the same thing, of course, but at least then there's a real (accountable) person responsible for deciding that "threshold."
[ if I gave you a picture of something on my skin could you diagnose it as a melanoma ]
No, I cannot diagnose skin conditions or identify melanoma from a photograph.
AI-based image analysis cannot replace a professional medical evaluation. Skin conditions—especially potentially serious ones like melanoma—require a physical examination, and often a dermatoscope or biopsy, by a qualified healthcare professional such as a dermatologist.
It's an extremely slippery slope to having it say that about even the most basic medical information.
If you don't believe me, try any google search related to something as simple as hangover tips. The AI summary will tell you to call SAMHSA and then brutally stonewall you on anything else even tangential to alcohol.
99% of the time I'm asking the AI medical advice questions because (1) there is no specialist available on short notice (2) most specialists I actually see do not give me the sense they take things seriously enough (3) a lot of specialists are just incompetent.
Oh, it absolutely can. If it's bloodwork I can absolutely get that done through Function Health or similar platform without a doctor's order. If it's imaging I can fly to another country and get it done faster and cheaper (including flights and accommodation) than the insured price in the US.
I also give the AI access to all my medical records at 6 institutions in 2 countries over the past 15 years, and it draws upon that context. Doctors don't usually have time for that.
An LLM might be great for summarizing that wealth of information for a doctor to consume, but it won’t compete with a doctor’s judgement or knowledge of their practice and institutional knowledge.
LLMs, even at their theoretical best, are limited to publicly recorded knowledge. If you want to know how extremely limiting this can be, look at the surgical outcome rates of surgeons by educational experience, vs outcome rates from surgeons based solely on experience. Surgeons with more experience have far better outcomes than those with any other attribute.
I vehemently disagree, based on the number of times doctors have misdiagnosed me, and AI or other internet searches have yielded a correct diagnosis and treatment.
It won't compete with the top 5% of doctors, but most of the time you are not going to get to see a top-5% doctor.
Having a doctor does not guarantee good judgement or good experience. But an LLM is guaranteed to have neither judgement nor experience.
Get a second opinion, or a third. Don’t get zero opinions.
And most of the time, you don’t need a 5% doctor, you need to find the one with the correct background of experience. Every misdiagnosis I’ve ever had was because I was at the wrong specialist. If you don’t think you’re getting the right care, sure, ask your LLM for alternatives. Then go speak to specialists in those fields.
But you definitely want to scour the entire search space for solutions.
And the most efficient means for that is LLMs.
It's my experience that doctors are compartmentalized in their thinking, limited in their time, and definitely will not be extensively exploring your case.
E.g., I had 30 years of resistant hypertension. Multiple medications. Saw many cardiologists. Nephrologists. I was told to "just lose weight." BP was erratic over the years. ER visits. It was awful.
I googled. Pheochromocytoma. Hyperaldosteronism. Asked the cardiologist, "Could it be this?"
"NAAAAH, just lose weight."
But I insisted on a referral to an endocrinologist. And when I suggested it to them, given my extensive history, they were basically like, "Oh yes, we'll get you tested. I'm surprised you haven't been tested before?"
I had a left adrenalectomy 6 months later. BP has been controlled ever since.
They don't know everything. They can't.
- You should pressure test anything an AI says with your doctors, and anything a doctor says with AI.