AI mistake or human foolishness

[Dreadboost]

So a family sue OpenAI, alleging GPT-4o for coaching their daughter to stop seizure medication. FULL GIST

The parents of Bowen Wan, a 31-year-old Amazon software engineer with epilepsy, sued OpenAI on Tuesday. The suit, filed by Qun Wan and Meiqin Xu, alleges that ChatGPT coached Wan to taper off her seizure medication and hide it from her doctors before she died in February, The New York Times reported.

My stance on this case, is that was she being foolish to reduce her doze by the instruction of OpenAI or should we blame OpenAI for actually telling someone on medication to reduce their dose or stop it?

[Joy_learns_crypto]

I have a loved one who is battling mild schizophrenia on his psychotherapy appointment, I happened to be there with him and he revealed that ChatGPT agreed with him that he need to leave alone, he has recently been seeking to leave alone now that ChatGPT agreed with him on that he is insisting that the professionals are wrong by telling him not to stay alone.

ChatGPT when in chat with anyone should direct them for and towards a real life professional advice, they can't keep giving out harmful suggestions and advice and it almost always what the victims chatting wants to get from them.

[_act_]

It is very possible that ChatGPT would have warned her about what she was about to do and not advise to do it, but give her suggestions if she wants.

So there would have been something like a disclaimer before ChatGPT give her the information.

She is 31 years and not a child. I expect a 31 years old to know that ChatGPT should not be used for something like that. ChatGPT also have a disclaimer in its terms of service that the information it might give at times may not be right.

[Free Market Capitalist]

So there would have been something like a disclaimer before ChatGPT give her the information.

Lately, AIs include a disclaimer if you ask about anything that might be medical in nature, but the news article refers to January of this year, and I'm not sure ChatGPT included that disclaimer back then. I think all AIs include it now because of cases like this and others like it.

[Exitoral]

Parents foolishness. Two people brought life into the world and left the world to mold their child. What did they expect. You didn't put in the work and want your children to be great. Neglected children always fall prey for this. You didn't take the blame, but when ahead to sue another company for your foolishness.

As they have sued the AI company now, what do they want them to do? Bring the daughter back to life? Yeah, the company too have to be up and doing on their platforms. Same as you as a parent, you have work to do. Don't give your job to another person and when it is done anyhow, you make trouble.

[Fiatless]

This is not the first time this sad event has happened. These chatbots have encouraged people to even commit suicide. I thought developers had put measures in place to stop these bad practices.

' A predator in your home': Mothers say chatbots encouraged their sons to kill themselves
The family of teenager who died by suicide alleges OpenAI's ChatGPT is to blame

We live in a society where people talk more with machines than with their fellow humans. Parents buy devices for their children and focus on their jobs without spending time with them.

A thirty-one-year-old who decided to follow a chatbot's suggestions might not be mentally or emotionally sound. A simple search would have revealed that the chat was pushing her to commit suicide.

OpenAI should also be held responsible for not putting in place preventive measures.

Parents foolishness. Two people brought life into the world and left the world to mold their child. What did they expect. You didn't put in the work and want your children to be great. Neglected children always fall prey for this. You didn't take the blame, but when ahead to sue another company for your foolishness.

Did you check the age of the victim?

[Ziskinberg]

They will never win the case because chat GPT always have a warning about.



This is what I've noticed on my account which I use mostly for programming.

And sometimes, it does not give me a direct answer, so if we just let ChatGPT decide on everything, it might really make mistakes. So when you ask, you need to communicate clearly and give the AI the full picture to get the best advice.

[Zeusky]

AI is actually the future, it has helped in so many aspect that are too numerous to mention but same way there are two sides of a coin there is actually a good and a bad effect of AI in our current society at large. Now let's go into the good aspect of AI.
> It helps make your task faster and easier, depending on the task given to it to perform. It surely delivers more faster than a human would.
> It also helps in the educational sector, helping students to actually understand and grasp knowledge faster and easier.
> It reduces human errors, it can perform task with high accuracy.
> It makes communication easier most especially the translation aspect.
> It also supports people with disabilities, that's one major part I really do love the use and efficiency of AI.

Now speaking of the bad aspect there's also so many things to mention as to why AI might seem like a human foolishness to some people and also they ain't wrong to feel such because if you're actually looking from there own perspective they're right.
> Job losses is one major thing about why AI feels wrong in our society, because so many organizations do depend and trust the job of an AI than depend on human power who would actually need rest and long time to think and evaluate a task being given to deliver. But AI can actually deliver such in a short period of time and also robots doesn't need time to rest, neither do they need food or bathroom breaks, but they can actually work till they're asked to stop.
> Privacy is also another edge to look at, most of us do ignore this aspect but it's actually  very dangerous if we look at it from another angle. Your personal information can be misused and can also implicate you if used wrongly or in the wrong space.

Lastly we could talk about the harmful activities AI can accomplish without restrictions, speaking of cyber attacks and also high grade weapons.

[Dr.Bitcoin_Strange]

Well, I feel sorry for her parent's loss. I am just surprise after reading that Ms. Wan is 31 years old and I am wondering how can a full grown adult make such a decision to follow medical advice given by AI, meanwhile she has a doctor in charge of her health issue. If she didn't like the doctor, she could have just changed to another doctor.

I can not entirely blame her parents in this case because their daughter was an adult who should have handle things more sensibly, but she chose to trust an AI more than her doctor. Athough I don't really support them suing the AI company, because the AI didn't forced their child to start asking such kind Kind of question in the first place, not when she already had a doctor she could consult.

The pattern allegedly started before she began tapering. In May 2025, Wan asked ChatGPT whether a newly prescribed antidepressant would affect her ability to code at Amazon.

[Mate2237]

Crazy story, this should be a lesson to those that assume that Ai can give the solution to everything including health related issues. There's a possibility that Ai must have shown the downsides of it but still decided to skip or reduce her medications which led to her death. The problem with a lot of people is that they fail to realize how dangerous it is to rely on Ai completely in whatever they use it for.


Ai will always come up with suggestions when people use it to search for certain questions that they need answers to, this is what it was designed or programmed to do. Ai is not an expert on human health related issues, it can only give you informations on whatever you need to know but taking the suggestions of Ai on health issues is somewhat risky.

[tsaroz]

So a family sue OpenAI, alleging GPT-4o for coaching their daughter to stop seizure medication. FULL GIST

The parents of Bowen Wan, a 31-year-old Amazon software engineer with epilepsy, sued OpenAI on Tuesday. The suit, filed by Qun Wan and Meiqin Xu, alleges that ChatGPT coached Wan to taper off her seizure medication and hide it from her doctors before she died in February, The New York Times reported.

My stance on this case, is that was she being foolish to reduce her doze by the instruction of OpenAI or should we blame OpenAI for actually telling someone on medication to reduce their dose or stop it?

That's a human mistake. The first mistake is to depend on AI for a very specific and serious medical case, Epilepsy in her case which requires the use of constant medication.
The AI never actually gives a straight suggestion to reduce the dozes unless the human asking tells they want to as the symptoms are getting less. I'm not an OpenAI lawyer or getting paid from it so I won't vouch for it. But in my self medication discussion from Chatgpt, it always asked me to visit a doctor, get a test before deciding what medicine to choose, I did bypassed it and it turned out to be a good analysis but like doctors, AI too could make mistakes.
I will still continue to use AI for my simple health diagnosis but for complications we need doctors and hospitals and real medical advice.

[Call_Me_Guru]

My stance on this case, is that was she being foolish to reduce her doze by the instruction of OpenAI or should we blame OpenAI for actually telling someone on medication to reduce their dose or stop it?

ChatGPT of version GPT-4o had received enough upgrades and refined instructions compared to the initial rolled out versions before it. I don't think it could be so careless and insensitive to tell a child to go against their physician's advice. I've never seen such a careless AI saying that. They could give careless medical advice at that time but will never say no to your doctor or pharmacist. What transpired could be deeper, the GPT-4o could say that, but have they thought about how the chat between it and the child arrived there?

"AI Can Make Mistakes, Let's Be Careful."

[Jaweria parveen]

If AI makes a mistake, instead of leaving it, we should accept our punishment so that we don't become stupid. Because when we ask AI questions according to its own, it can create answers for you for a while, but that doesn't mean that it will give the wrong answer. Although it can collect some stories that are its answers and not written down, it has told them by looking at them. AI is for our convenience, but it also makes mistakes because I have had many experiences with it where it is wrong. Humans are now ready to believe everything it says and its origin becomes clear when they search for something themselves and differ according to its help, then AI is making mistakes. We should try not to help AI too much, but if we do, then we should use it as evidence.

[kingstep]

ChatGPT when in chat with anyone should direct them for and towards a real life professional advice, they can't keep giving out harmful suggestions and advice and it almost always what the victims chatting wants to get from them.

There had been instances when i asked chatGPT for assistance as it relates to medical related concerns, in all of those instances, i got a decline which refused giving me a direct medical advice telling me that i need to get the right advice from a qualified medical practitioner who is in the best position to give me such medical related guidance.

As a parent, if you leave a child to use a knife in harming himself, would you blame the person that crafted the knife or blame it or your carelessness for not being available?  If your child is sick, there are things they should not be exposed to because of potential abuse of those things and so for this, i will tag it to be a form of carelessness on the part of the parents.

[freedomgo]

I checked the TOS of open AI,

https://openai.com/policies/row-terms-of-use/

When you use our Services you understand and agree:

Output may not always be accurate. You should not rely on Output from our Services as a sole source of truth or factual information, or as a substitute for professional advice.

Once we sign up, we agree with that terms, so most likely the "victim" has not read that terms, she just sign up blindly.
Of course she can file a lawsuit, but obviously she has no slim chance of winning.

[Yorubek]

My stance on this case, is that was she being foolish to reduce her doze by the instruction of OpenAI or should we blame OpenAI for actually telling someone on medication to reduce their dose or stop it?

ChatGPT can help people in many way, but I think it is never reasonable to reduce the dose of medicine based on OpenAI opinion without relying on the doctor advice. I honestly don't know what kind of chat was going on between them. It is a matter of thinking that a person can rely on ChatGPT without relying on the doctor. If ChatGPT could provide people with proper treatment, then there would be no need for a doctor.

Where life and death are involved, I don't understand how ChatGPT can tell a person to reduce the dose of medicine and forbid them from telling the doctor. It is absolutely not right to make such decisions based on ChatGPT, awareness is very important for every person which can save people from great danger.

[bisdak40]

It is always not advisable that we will use AI as means for medical assistance we always go to a professional doctors for this kind of things. Also AI has a disclaimer that will prompt to let the users not make AI as advisers for medical matters and prompts to seek to a professional and also AI can make mistakes. With the rise of AI we must not always rely on it especially for illnesses and medication we must seek for professionals we should learn from this event how it can cause a life of a person.

[Sanitough]

My stance on this case, is that was she being foolish to reduce her doze by the instruction of OpenAI or should we blame OpenAI for actually telling someone on medication to reduce their dose or stop it?

The question is, who actually she trusted more, her doctor or this OpenAI? The answer to this will lead why she end up dying.

She knows her body well, she knows her condition, and that's why she has her medication. So why she resort on relying on OpenAI when she already knew that its not her doctor, and it won't save her whenever she experience seizures.

I think the one to be blame here is the patient alone, their daughter. Not OpenAI as we all know that AI isn't perfect.

[Kelvinid]

They will never win the case because chat GPT always have a warning about.



This is what I've noticed on my account which I use mostly for programming.

And sometimes, it does not give me a direct answer, so if we just let ChatGPT decide on everything, it might really make mistakes. So when you ask, you need to communicate clearly and give the AI the full picture to get the best advice.

Even so, its not really advisable to rely on ChatGPT when it comes to serious illness like having seizures. It can make suggestions and answer our queries but at the end of the day, she should still consult her physician about it.

And maybe she's just having a lot of distractions in her mind that she forgot the warning that ChatGPT also create mistakes and not completely reliable especially in special cases like what she is suffering.

[Obim34]

My stance on this case, is that was she being foolish to reduce her doze by the instruction of OpenAI or should we blame OpenAI for actually telling someone on medication to reduce their dose or stop it?

What else than calling her foolish? Was she trying to cut the service fee from seeing her doctor? Probably, she thought AI could replace a qualified doctor to handle her health issue, people can be stupid, but it shouldn't be to the point where it endangers their life. Full blame goes to her and not the AI, she wouldn't have won the case.