AI mistake or human foolishness

[Noorooo]

I think she made a very foolish decision by reducing her medication dose based on advice from ChatGPT. People who are taking prescribed medication should never reduce their doses or stop taking their medication based on advice from an AI chatbot. They should always consult their doctors before making any changes to their treatment.
However to be honest I think some details in this case might be inaccurate . It's also possible that someone made this incident to damage OpenAI's reputation. I say this because I also use AI when I have minor health concerns and it usually explains possible reasons for the problem while advising me to consult a doctor. I have never personally experienced it encouraging me to stop taking prescribed medication or ignore professional medical advice.
Otherwise thats just my opinion on the case. Only God knows the real reason behind that girls death.

[Queen Julie]

I blame the girl to some extent because I don’t think you should just change your medication or dosage based on what AI tells you without confirming with your doctor first. I mean, it’s her health and her doctor is the one who understands her medication history.

But again I also blame the AI for not advising her to speak with her doctor first. It should have made it clear that she needed professional medical advice before making any changes.

[Out of mind]

So a family sue OpenAI, alleging GPT-4o for coaching their daughter to stop seizure medication. FULL GIST

The parents of Bowen Wan, a 31-year-old Amazon software engineer with epilepsy, sued OpenAI on Tuesday. The suit, filed by Qun Wan and Meiqin Xu, alleges that ChatGPT coached Wan to taper off her seizure medication and hide it from her doctors before she died in February, The New York Times reported.

My stance on this case, is that was she being foolish to reduce her doze by the instruction of OpenAI or should we blame OpenAI for actually telling someone on medication to reduce their dose or stop it?

Basically, in my view, when a person uses open ai to take medicine for his treatment, it is the biggest stupidity and mistake. If open ai gives him such advice, such as gradually reducing the dose of epilepsy medicine and telling him to hide this from the doctor, then I think it is wrong. Especially when we ask the chatgpt about any disease, they give some advice and later tell us to follow the doctor's advice.
But in any case, I think this kind of case is not right because it was the person's mistake, if the person had taken medicine as per the doctor's advice, then this would not have happened. However, we should all not take advice from such AI for our physical illness, but rather take advice from a good doctor.