upvote
I heard the same argument from my doctor when I wanted a blood scan.

But what's the intention? If you do a scan and then try to find everything that is wrong about you, you're 100% right, there will be false positives and unnecessary panic/medication etc.

However if you just collect data for months and years and WHEN you get a symptom you have a lot more data then we should be able to give better diagnosis faster. If we do that for long enough as humanity and there is data sharing the accuracy of the whole thing will increase a lot.

reply
I think it's (at least partly) about the psychological impact of finding something unusual. Even if you know that it's probably nothing and understand the Bayes theorem, there will be a "what if" that might be strong enough to do actual harm (nocebo effect).

Compare: The placebo effect works (at a reduced rate) even if you tell people they're getting a placebo!

reply
This. All diagnoses are "given this set of symptoms and test results, which is the most likely issue".

By having a whole slew of test results already, you will have much better priors.

reply
So you are certainly correct but you can also tighten up your definitions for true positives as you have more information on your false positives. There may exist additional signal as well.

To your point though I think there is a difference between collecting and evaluating additional data sources and using them as diagnostic tools.

I suppose I fundamentally disagree with the implication of your post that there is no value in gathering further data for these reasons, it would seem to suggest we’re already diagnostically optimal and could not do better with additional signal.

reply
Sure collecting more data makes sense. We agree there. If that gets you to the required degree of statistical confidence my argument is moot.
reply
Positive for what, exactly? Quoting convnet, above:

> The downside, and the reason why most doctors do not recommend full body scans, is that every human body is a bit weird and there will almost always be something "wrong" that will be visible in a full body scan. This can lead to unnecessary testing, anxiety, and even unnecessary procedures. Many of these oddities flagged by the scan would never have caused any actual issues had the patient never been aware.

The fundamental problem is that you generally can't diagnose simply from shapes. Scans show shapes, shapes cause concern, concern leads to invasive procedures, results are negative.

Also, overdependency on "spas" for health information could lead to an atrophy of other sorts of medical information gathering and diagnosis. e.g., there's no mention in the dreamy description of this spa experience of getting a blood draw or a patellar reflex test.

reply
The root comment is talking about adding blood, breath, urin, spit... analysis. For body imaging only I agree with you. But if we add all this, I guess we'd be able to rule out many false positives
reply
Your "guess" is not merely incorrect but logically invalid ... such added tests (which ex hypothesi are all negative) have no bearing on false positives from tomography.
reply
That's precisely where medicine is headed: personalized medicine.

You [hopefully] won't have to become a rare missed diagnosis because you didn't fit the demographic for this or that screening test.

Cost of genomic analysis is exponentially decreasing, and so much progress is happening so quickly.

Consider for example how in cardiology we advanced from ASCVD's 10-yr prognosis, to the PREVENT 30-yr prognosis. And still most providers are using the ASCVD score for their patients.

reply
You’re dealing with populations here. Literally the odds of a positive being false would be over 90%. Much higher in the more rare conditions. I’m not exaggerating. That means every almost every follow up you do is a waste of time, money and limited resources, denying care to those who need it. Including you when you actually do need it. It also exposes you to the risks of unnecessary follow-ups like infection. Your expected outcome is worse this way.

The chance a positive is real is so low you may as well just point to a body part and get it biopsied.

A positive from this kind of test is statistically meaningless.

reply
It's scary in both directions.

If you let it give out tons of false positives, then patients are trained to ignore it when it cries wolf.

If you dial it back so that it gives out fewer positives, then now it starts giving out false negatives and not helping sick people.

reply
Heh, Signal Detection Theory strikes again! This problem is as old as detecting whether a radar blip is a WW2 bomber on its way or not.

Sadly, there's no perfect threshold when the signal and noise distributions overlap substantially, just different trade-offs.

(Love CI, btw!)

reply
You're right. I wrote a bad response at midnight. I meant to say something more narrow and specific: genomic assessments and new biomarker tests will become affordable and add information.

For example, single nucleotide polymorphisms. This way doctors spend less time guessing which medication is likely to work best for you when there are many options available.

reply
That doesn't sound like a useful test then. Instead use tests with fewer false positives.
reply
If this argument was as solid as you say, then all routine checks would be pointless.

I don't know about traditional blood testing, but a permanent implant which checks HR, pressure, glucose, temperature & oxidation would be pretty useful, not necessarily to diagnose anything, but to provide data for doctor when patient has actual symptomps.

reply
They kind of are. Spain doesn't have yearly physicals, and during a GP visit, they don't even take your blood pressure. Blood tests are extremely uncommon, unlike in British medicine, where they take your blood pressure every time and blood tests are so prevalent people usually request one from time to time despite having no symptoms. Spain's example showed the above (or the lack of) doesn't increase all-cause mortality and even excelling in longevity statistics.

https://www.rieti.go.jp/en/columns/a01_0455.html This japanese article found "No clear-cut evidence exists to determine whether undergoing health checks leads to greater longevity and/or lower medical expenditures."

reply
Several published papers agree. There is in fact little evidence to support regular checkups if you’re asymptomatic.

https://pubmed.ncbi.nlm.nih.gov/31642821/

And blood pressure is especially pernicious, basically every doctors office measures it wrong so the results aren’t particularly useful. Many use the wrong size cuff for example, or don’t give people time to relax before a reading. A ton of people have white coat hypertension, high BP only because they’re in a doctors office.

https://pmc.ncbi.nlm.nih.gov/articles/PMC1120072/

I saw a paper that showed only 36% of cardiologists did it right.

reply
Math does indeed make for solid arguments. If you want to make a counterargument then you have to address their math, which you didn't.
reply
You've got that completely backwards. Correctly applying Bayes' theorem, if an anomaly is observed you incorporate the prior into the calculation of the posterior probability. You don't just give up and say "the prior is miniscule so the likelihood is useless".

And then, even that's not enough. Decision theory needs to be applied to decide what action to take. That means taking into account the expected QALYs, cost and inconvenience across the distribution of possible outcomes. There's a whole spectrum of possible decisions, from immediately performing surgery, performing an invasive test like a biopsy, performing other less invasive tests, scheduling a follow-up non-invasive test at a later date, or just following a regular schedule of non-invasive tests and looking for any evolution along a longer time period.

The real problem is the binary thinking of either "we think you have X" and therefore tests must be performed or "we think you don't have X" and therefore tests shouldn't be performed. If medical organizations adopted empirically grounded decision frameworks, by applying them consistently doctors would be able to see something anomalous, assess that the risk isn't high enough to warrant immediate investigation, and be protected from a lawsuit in the unlikely case it was, in fact, something. And then we could do away with this "if we look we might find something" nonsense, which is pure fallacy.

reply
This is why you have multiple successive panels. If there's a disease that happens for 1 in 10k people, and you have a test with 1% FPR, 99 of 100 people will be false positive.

But what you can do then, is either run a more expensive, elaborate test or one that's proven to be statistically independent on the positive testing population.

FPR can even be a good thing. Let's say you have an expensive test with a very low false positive rate. Then you can mix together 100 samples, and get a test with a much worse FPR 100 times cheaper. Then you can repeat the same individually on the positive population.

This is fully automatic and you don't even think about it. Btw, this is why mass testing, and public healthcare can be better. You can amortize the cost of things across a large number of people for no disadvantage.

reply
The argument has some merits, but we should remember that, from the point of view of Bayes, you could apply the same argument to symptoms, which is only evidence. High odds of a false positive, means that you have not enough evidence, not that you have not useful information.
reply
Testing healthy person for any illness by definition has infinite number of nines in false positive rate.

Problem is we never know who is healthy. That is why we are doing the test.

reply
We could test symptomatic people.
reply
Medicine is not a statistical field. I've seen many times doctors dismissing someone "you're young, you can't have X". Although there is some truth in what you're saying: full body CT scans are on the rise now.
reply
deleted
reply
You can just run more tests to get increased statistical power.
reply
No you can't. Statistical tests assume independent data points. Testing the same individual repeatedly would be pseudoreplication, leading to wrong conclusions.

If you mean run different tests, where you collect different kinds of data from the same individual, sure but that's not something you can "just do" in the general case.

reply
Many smaht people have already pointed that out.

It's news to no one that tests are imperfect.

Do you have any concrete solution to that? Anything of value?

reply
Yes, don’t do tests on asymptomatic low-risk people until you can demonstrate that a positive result has any meaning whatsoever.
reply
Hypertension is asymptomatic for years and is prevalent in every demographic. Leaving it unattended it can cause stroke, heart attack, or organ damage through long-term vessel strain, by which time damage may be irreversible; detecting it on time can prevent this with lifestyle changes and medication.

Diabetes is asymptomatic for years and is prevalent in every demographic. Leaving it unattended it can cause damage to blood vessels, nerves, kidneys, and eyes through chronic high blood sugar, by which time complications may be advanced; detecting it on time can prevent or delay this with treatment and lifestyle changes.

Hyperlipidemia is asymptomatic for years and is prevalent in every demographic. Leaving it unattended it can cause artery blockage through cholesterol buildup, by which time heart attack or stroke may occur; detecting it on time can prevent this with diet and medication.

Kidney disease is asymptomatic for years and is prevalent in every demographic. Leaving it unattended it can cause kidney failure through gradual loss of function, by which time dialysis may be needed; detecting it on time can slow progression.

Glaucoma is asymptomatic for years and is prevalent in every demographic. Leaving it unattended it can cause irreversible vision loss through optic nerve damage, by which time blindness may be permanent; detecting it on time can preserve vision.

--------

I'm SO glad you're not my family doctor!

reply
At least the top 4, unclear about the 5th, are strongly associated with obesity. That would make someone high-risk and testing potentially warranted in like 70% of the population. Asymptomatic and low-risk is what I said. The incidence of hypertension is so high in the general population it’s almost always statistically supported (even though basically every doctors office takes it wrong, even cardiologists, amazingly).

On the other end of the spectrum, what doesn’t make sense is testing a random person off the street for Ebola. The prevalence approaches zero and symptoms are fairly noticeable, so any positive test is definitely wrong.

Most diseases are in between and have to be evaluated case by case, not buckshot.

You may be particularly interested to hear that there’s little evidence to support regular checkups in most adults beyond blood pressure testing and cervical cytology.

> Given the lack of favorable evidence and the potential adverse effect, primary care providers should consider the fact that general health checks, beyond the screening interventions shown to have benefit, likely have little or no effect on important health outcomes. Some of the interventions with demonstrated benefit have sufficiently large effects that a uniform application is warranted (blood pressure measurement and cervical cytology screening). In others, the trade‑off between benefits and harms is so close that patients should be involved in fully shared decision making regarding their participation (breast and colon cancer screening).

https://pubmed.ncbi.nlm.nih.gov/31642821/

I suspect your doctor would agree with me. See if they’ll test you for Ebola, for instance. Not because you have symptoms but just cuz.

reply
I mostly agree with you by one small wrinkle is that the evaluation of screening is normally against a criteria of cost effectiveness as well as safety. So for some conditions, if cost effectiveness was the barrier to rollout it might still be worth it if you are rich?
reply
The decision as to whether mass screening is justified or not is complex, and varies a lot by test/condition/population etc. Luckily there are lots of smart people whose job it is to do these caclulations.

In your list, 1-4 are common enough, the tests are accurate enough, the costs of intervention are low enough and the benefits of early intervention are high enough to justify screening, which is why they do generally screen for them at least in hgiher risk groups. The other two are more mixed, which is why mass screening is less common.

All the evidence for full body scans is that they are not justified for asymptomatic people. The false positives are high, the costs of these false positives are high, and the imporved outcomes are too low to justify them. If you want one, go ahead, but realise that almost anything it finds is likely to be false either positive or not likely to ever cause a problem, and you'd have to deal with the worry and invasive tests and even surgery in aid of something that may never cause any trouble.

reply