> No diabetic with baseline adult competence is going to drive their insulin-delivery vehicle off a cliff because some app said so.

if you can't trust this thing then what is it doing? the implication that people that trust this software do not have adult competency is also confusing.

> Is your perspective based on, say, opinionated principle?, or experience?

your perspective is solely based on recent trauma so I don't know if it is more reliable in any capacity

I think you're being too optimistic about your fellow humans' judgement. "Death by GPS" is a quite common occurrence: https://www.sciencedirect.com/science/article/abs/pii/S13550...

> The risks; What risks? No diabetic with baseline adult competence is going to drive their insulin-delivery vehicle off a cliff because some app said so.

My local physician says otherwise, with respect to facebook posts about dosages. I'm convinced the same applies to LLM generated content with respect to people blindly following the computer.

Risks:

Changing parameters on the insulin pump because the LLM said so

Neglecting to seek actual medical advice believing a LLM replaces it

Misunderstanding medical complexity (ie a prescription due to medical history not available to the LLM)

> No diabetic with baseline adult competence is going to drive their insulin-delivery vehicle off a cliff because some app said so.

You 1000% don't work with the general public in a tech way.