AI mistake or human foolishness

[Jasmyne]

I once asked AI to suggest medicine for a problem. AI suggested medicine but advised to take it after consulting a doctor.

Now if AI model ever makes a mistake and directly suggests medicine or makes a decision that can cause harm later, then it is really very dangerous. But I noticed that OpenAI states that AI can sometimes make mistakes. So a user should not consciously make a decision based on that information. And I think that AI should not directly decide on any treatment in this case. And those who use AI to make decisions on dangerous and risky matters should not completely rely on AI for sensitive matters.

First of all we need to accept the fact that it is humans lack of strength to research that gave bath to the introduction of artificial intelligence to the world today. Artificial intelligence has made things become very simple but humans now rely on it for things that needs the assistance of professionals in that field. Of course artificial intelligence will always have a solution to whatever you will ask it but does it make sense to believe everything whenhas to do with human health no. Artificial intelligence can make mistakes you have to stop relying on what you get from artificial intelligence especially health related questions don't believe everything but if you consult a professional in that field you can have someone that will direct you properly while you also know the person or hospital you got your medication from.

[Crypto_Timothy]

So a family sue OpenAI, alleging GPT-4o for coaching their daughter to stop seizure medication. FULL GIST

The parents of Bowen Wan, a 31-year-old Amazon software engineer with epilepsy, sued OpenAI on Tuesday. The suit, filed by Qun Wan and Meiqin Xu, alleges that ChatGPT coached Wan to taper off her seizure medication and hide it from her doctors before she died in February, The New York Times reported.

My stance on this case, is that was she being foolish to reduce her doze by the instruction of OpenAI or should we blame OpenAI for actually telling someone on medication to reduce their dose or stop it?

I think thats equivalent to someone searching up things on Google search and then taking whatever advice that google search give them and still later coming to sue google for advising their kid on medications. First a 31-year old, i shouldnt even use the word "kid" thats a grown up woman and yet he is taking medical advise from online? I can not even put it to the parents that they should have been watching her because again, 31 is not a small age at all, in most cases she would already have a kid of hers by now so its certainly not a small age.
I read the article and im just in shock especially reading some of the chats she had with AI and if at all i must say there should be a campaign aimed at making people know certainly that whatever you see online should not be taken by heart, especially medical conversations. Thats all i can add to this but suing is just off to me considering how much more responsible she should have been. I see the suing as trying to put the blame somewhere external.

[snowpega]

So a family sue OpenAI, alleging GPT-4o for coaching their daughter to stop seizure medication. FULL GIST

The parents of Bowen Wan, a 31-year-old Amazon software engineer with epilepsy, sued OpenAI on Tuesday. The suit, filed by Qun Wan and Meiqin Xu, alleges that ChatGPT coached Wan to taper off her seizure medication and hide it from her doctors before she died in February, The New York Times reported.

My stance on this case, is that was she being foolish to reduce her doze by the instruction of OpenAI or should we blame OpenAI for actually telling someone on medication to reduce their dose or stop it?

I also came across this news recently while scrolling social media reels. And this literally shocked me. What wonders me the most was that the lady who used the AI for medication was not a child. She was well educated and developer, right? And still expecting such things from an educated person "i have no words for this". I believe that you can use AI for the purpose to gain information amd knowledge and taking action on its saying is a stupidity in my point of view.

Like, you can use AI to check about your medicine information like how it works its advantages and disadvantages. But considering it as your doctor is a big no on my point of view. I don't know why we as an educated humans started to depend more on AI technology. It is making our IQ level weak which is also a big problem in my point of view. CMIIW!

[Bityar]

My stance on this case, is that was she being foolish to reduce her doze by the instruction of OpenAI or should we blame OpenAI for actually telling someone on medication to reduce their dose or stop it?

Definitely its her foolishness open AI is a robot and it has no emotions it just give you information or guidance. A person just have to take idea from it nothing else. Why she have trust AI for his health like for health we should always go for a doctor. We should not trust on AI on our health or some personal issues. It is simple a robot and a help full tool we should also use our common sense using it. Yes AI companies have a responsibility like that in these kind of sesitive situations they just give clear warning not to say for medication change or to stop medications. But in your scenario i think its full her foolishness or mistake. We should not share our personal issues to it instead we should use AI for our personal work studies or for some guidance.

[SuperBitMan]

My stance on this case, is that was she being foolish to reduce her doze by the instruction of OpenAI or should we blame OpenAI for actually telling someone on medication to reduce their dose or stop it?

What else than calling her foolish? Was she trying to cut the service fee from seeing her doctor? Probably, she thought AI could replace a qualified doctor to handle her health issue, people can be stupid, but it shouldn't be to the point where it endangers their life. Full blame goes to her and not the AI, she wouldn't have won the case.

I had read about this incident before, so it turns out it was real. The family is absolutely right to file a lawsuit. I can understand why you're calling it stupidity, because they should have consulted an actual doctor instead of relying on AI. I just don't understand why people put so much trust and meaning into a machine that generates random answers based on the information it has.

People of this generation believe that anything they see online or anything that AI gives to them is true. They forget that it is still human that puts the information they give out and humans can be wrong no matter how knowledgeable the human is.
People will continue to believe and trust anything that AI gives to them. It is true that AI is actually an intelligent machine that was created to solve some human needs however, it is wrong not to do other findings when AI gives you an answer.

I’m interested to see how this particular case will end in court.

[Tungbulu]

People of this generation believe that anything they see online or anything that AI gives to them is true. They forget that it is still human that puts the information they give out and humans can be wrong no matter how knowledgeable the human is.
People will continue to believe and trust anything that AI gives to them. It is true that AI is actually an intelligent machine that was created to solve some human needs however, it is wrong not to do other findings when AI gives you an answer.

I’m interested to see how this particular case will end in court.

Thing is, AI is really overrated by so many people lately, they treat the answers and information gotten from AI as if it’s gospel. Even if AI has been proven to countless times to be exceptionally helpful when it comes with information sourcing and data collection, it wouldn’t cost anything at all to take a quick search on other platforms and sites to confirm if the information provided by the AI is actually solid.
Sometimes the problem isn’t really AI itself, but people’s expectations of it and also their heavy reliance on AI.

[Sally9256]

First of all we need to accept the fact that it is humans lack of strength to research that gave bath to the introduction of artificial intelligence to the world today. Artificial intelligence has made things become very simple but humans now rely on it for things that needs the assistance of professionals in that field. Of course artificial intelligence will always have a solution to whatever you will ask it but does it make sense to believe everything whenhas to do with human health no. Artificial intelligence can make mistakes you have to stop relying on what you get from artificial intelligence especially health related questions don't believe everything but if you consult a professional in that field you can have someone that will direct you properly while you also know the person or hospital you got your medication from.

The aim of introducing AI has always been to simplify things for human and make it so easy and stress free for them but the problem usually is that people begin to abuse it usage and they try to rely on it fully for even things they could have done without using AI, people start to get too lazy to even do basic things.

I think for things related to human health even AI will advise you to seek a professional advise/attention after telling you what needs to be done. AI will only tell u a few things but professionals have a better solution for you. AI is useful but can't solve physical problems for you.

[LogitechMouse]

---
My stance on this case, is that was she being foolish to reduce her doze by the instruction of OpenAI or should we blame OpenAI for actually telling someone on medication to reduce their dose or stop it?

If you will look below near the text box if you put the prompt, there's a small sentence there that says.
"ChatGPT can make mistakes. Check important info."

This is their version of "Gamble Responsibly" when it comes to these gambling casinos. This is to show that they could generate mistakes, and they aren't the one to blame whenever they do it. It's like they're saying that "We warned you", but you still continued to do it. Should we blame OpenAI? For me, no and this is the reason why when it comes to medical aspects of life, I always go with a specialist or an expert "HUMAN" instead of just relying on what an LLM like ChatGPT is giving to us. VALUE OUR HEALTH, and with valuing our health includes going to a HUMAN DOCTOR whenever we feel something bad.

I don't want to call that person who died as foolish, but he's kinda TBH. I'm sorry, and I know that he's dead already, but to rely on an AI when it comes to his health? Like come on?? Even a non-stupid person will never do that especially with a serious illness like epilepsy and seizure. If it's something like cough, cold, or those light illness then probably, but with like that kind of illness? Nope.

[Freeveto]

First of all we need to accept the fact that it is humans lack of strength to research that gave bath to the introduction of artificial intelligence to the world today. Artificial intelligence has made things become very simple but humans now rely on it for things that needs the assistance of professionals in that field. Of course artificial intelligence will always have a solution to whatever you will ask it but does it make sense to believe everything whenhas to do with human health no. Artificial intelligence can make mistakes you have to stop relying on what you get from artificial intelligence especially health related questions don't believe everything but if you consult a professional in that field you can have someone that will direct you properly while you also know the person or hospital you got your medication from.

Yes, AI has made our search easy, they interact with us to help us find solution to our problems, they make life easy to leave and make findings easy. But there are somethings that are very sensitive which I don’t encourage the use of AI especially when it comes to medical consultations because they are not humans, and in medical aspect, we need professionals to handle the matter because it’s all about our health, we need to visit the hospital to get proper treatment because it is all bout our health.

I don’t expect the daughter to consult AI, she should have just call an emergency to come for help to take her to the hospital for proper treatment, and I think the AI would have recommended that she go to the hospital for proper treatment as well.

[viljy]

I believe that any person in their right mind should understand that AI is not an officially licensed doctor, and therefore its advice cannot have the status of treatment prescribed by a doctor. Here, the patient deliberately failed to follow the medical instructions, which led to the death. As for whether the court will rule in favor of the plaintiff - well, I don’t know... I’m not that familiar with American law. Fundamentally, however, the fault lies with the patient themselves.

[YUriy1991]

I believe that any person in their right mind should understand that AI is not an officially licensed doctor, and therefore its advice cannot have the status of treatment prescribed by a doctor. Here, the patient deliberately failed to follow the medical instructions, which led to the death. As for whether the court will rule in favor of the plaintiff - well, I don’t know... I’m not that familiar with American law. Fundamentally, however, the fault lies with the patient themselves.

Setting aside the legal issues, it seems to me that while the AI ​​did provide information in response to the patient inquiry, the patient failed to provide a complete picture of her medical condition. She did not include a detailed description in prompt, which led the AI ​​to reach a conclusion that proved fatal for her. For someone weary of taking medication, it might seem logical when an AI suggests reducing the dosage, but it was reckless of her to follow that advice without further research or the guidance of another person. The result was tragic she lost her life. If the family was aware that their daughter was consulting an AI and consented to her reducing her medication dosage, then Open AI cannot be held liable simply for an incorrect analysis. Because the decision to action upon an opinion rests with humans, not with AI.

[batang_bitcoin]

As a parent, if you leave a child to use a knife in harming himself, would you blame the person that crafted the knife or blame it or your carelessness for not being available?

It's on the parents because they have allowed their kid to have that tool when it's not necessary to hold it and they don't know how to use it properly. If they only see on how it can be used for good, it doesn't mean that they won't have an idea of using it to harm people too. And that's the same with AI, you leave it on the hands of the irresponsible people then it can do harm to them.

If your child is sick, there are things they should not be exposed to because of potential abuse of those things and so for this, i will tag it to be a form of carelessness on the part of the parents.

I guess that is so too, the parents anticipated that their child can understand more of it due to the process of getting to the legal age but, it's still insufficient reason why they have allowed their kid to have device that they have never checked what the child is up to.

[Unknown Op]

If AI makes a mistake, instead of leaving it, we should accept our punishment so that we don't become stupid. Because when we ask AI questions according to its own, it can create answers for you for a while, but that doesn't mean that it will give the wrong answer. Although it can collect some stories that are its answers and not written down, it has told them by looking at them. AI is for our convenience, but it also makes mistakes because I have had many experiences with it where it is wrong. Humans are now ready to believe everything it says and its origin becomes clear when they search for something themselves and differ according to its help, then AI is making mistakes. We should try not to help AI too much, but if we do, then we should use it as evidence.

Agree with your point but I think the main concern is about artificial intelligence itself and also how people are using it. AI is indeed working really fast it is giving good output. The companies are becoming dependent on it. They are trying to replace old employees so that they can reduce their expenses. This is going to create a lot of unemployment among people. Especially for people who do not have opportunity and resources to learn new skills. Students and workers are becoming too dependent on AI. Instead of developing their own research skills and problem solving strategies, they are trying to get every answer from AI. AI is also collecting a huge amount of information and if data is misused, it can expose personal information. We cannot blame AI for every negative outcome because humans also have ability to think, control and deploy system. It is just a tool and it should be considered tool to improve our lives not create more problems for us.

[Nanga Parbat]

The same water that keeps the fish alive can also be a tool to kill the fish (boiling the water) this is how i see AI.
Most times AI tells us what we want to hear and when it doesn’t we still orchestrate the next question in such a way that it pleases our expectation.
I would not blame AI entirely i will blame the humans because some people treat AI like a psychotherapist which is wrong. AI has limited knowledge and can therefore not be accurate in every single information or knowledge, this is something we should take very seriously.

AI is made just to make life easier its not human mistake. But user irresponsible use can turn it into any foolishness. Otherwise it is a tool that always available for help when nobody is ready to assist you. In my country parents provide AI tools to her daughter for upgrading her knowledge, but they have not kept close eyes on her online activities. She after exploring different apps got the access to some sensitive sites, slowly and gradually harmful gangs approach to her or they used her with different illegal acts that not only was harmful for her mental health but physical as well. While parents were totally unaware about her daughter's suspicious activities. Now Whose fault is here , is it technology or Parents negligence, AI can help the students in many ways. But if users make irresponsible steps while using it then obviously it can turn into big mistake.
AI can think better, provide solutions of your problems, source of information but it would be human errors if they totally depends on it, not focus on their own improvement,too much rely on it. Thses habits can affect personal abilities and creativity.

[Vod]

So there would have been something like a disclaimer before ChatGPT give her the information.

She is 31 years and not a child. I expect a 31 years old to know that ChatGPT should not be used for something like that. ChatGPT also have a disclaimer in its terms of service that the information it might give at times may not be right.

ChatGPT is AI and can make mistakes. is included with every answer.

I wonder if this family has the money to take it all the way to the highest court and set a precedence.  If they won, AI would be forced to stop giving any kind of advice that could hurt.  :/

[Cleanshit]

People of this generation believe that anything they see online or anything that AI gives to them is true. They forget that it is still human that puts the information they give out and humans can be wrong no matter how knowledgeable the human is.
People will continue to believe and trust anything that AI gives to them. It is true that AI is actually an intelligent machine that was created to solve some human needs however, it is wrong not to do other findings when AI gives you an answer.

I’m interested to see how this particular case will end in court.

This Ai issue should be something we are to get used to in this generation and that just the truth, people even think Ai is magic but it not, it just a pattern machine which is been commanded by we the humans to put up something online, both good information and bad information that same humans who add good knowledge to and were have bad humans who don’t want to add value to it.

Which I think you just made mention of AI was created to solve human needs, not to replace human thinking. But most people have really try to turn it against humanity.