AI mistake or human foolishness

[coin-investor]

So a family sue OpenAI, alleging GPT-4o for coaching their daughter to stop seizure medication.

My stance on this case, is that was she being foolish to reduce her doze by the instruction of OpenAI or should we blame OpenAI for actually telling someone on medication to reduce their dose or stop it?

We are responsible for all our actions, and placing your trust in AI, which is not 100% perfect when it comes to diagnosis, is a fatal mistake. He knows that only a doctor can recommend a dosage based on laboratory tests, but he still proceeded.
People should understand what AI is and is not, AI's are not all - knowing, there is information that needs to verified and tested, and one of these is when it comes to the dosage of the medication.

[General_Bitcoin]

We are responsible for all our actions, and placing your trust in AI, which is not 100% perfect when it comes to diagnosis, is a fatal mistake. He knows that only a doctor can recommend a dosage based on laboratory tests, but he still proceeded.
People should understand what AI is and is not, AI's are not all - knowing, there is information that needs to verified and tested, and one of these is when it comes to the dosage of the medication.

I would agree that people shouldn’t completely trust the AI with medical advice, although the user cannot always be blamed. Most people do not fully understand how the AI works and could take the advice seriously if they have a medical problem. If the AI is advising them to reduce or stop their prescribed medication then this is a serious flaw in the system.
 Medical advice should always be checked by a qualified doctor however the AI companies should also ensure their systems aren’t giving dangerous advice. Both parties should take responsibility.

[Dave1]

It is very possible that ChatGPT would have warned her about what she was about to do and not advise to do it, but give her suggestions if she wants.

Yes, I have also a medical condition and sometimes I will ask ChatGPT about it. But there will always be a disclaimer for it saying that if you lower your dosage you might have this kind of X effect and so I still need to monitor everything first.

Although we have different conditions, but still you really need to be very cautious on what AI will tell you and for us to learn to read between the line and not totally 100% dependent on it as if you are talking to a doctor or a physician.