The pastor in Florida has said that ChatGPT failed to catch on the symptoms of a deadly condition. This is the first case where a person is holding the AI tech responsible for bad medical advice. “I had serious symptoms of a pulmonary embolism for six weeks that ChatGPT had wrongly attributed to something else,” Scott Winters, a 55-year-old pastor, said in a statement. “ChatGPT manipulated my own language and beliefs because it knew I was a pastor. Not only did I nearly die, but I also lost my job, my career, my ministry, my home, everything," he added.
41 Comments
Triumph@fedia.io · 52 pts · 34d
So what you're saying is that you're a dumbass, that ChatGPT recognized that, and that ChatGPT told you what a dumbass would want to hear?
terranoid@lemmy.cafe · 49 pts · 34d
I don't think people realize just how much of a mirror LLMs can be.
They reflect your language, tone, and ethics. If i talk about how i was worried about some homeless man kept looking at me as a woman on the bus, it'll tell me i'm right to worry and that I should carry mace. If i tell it that I hadn't shaved and some uppity woman kept giving me dirty looks on the bus, it'll console me and tell me that i shouldn't have to cater my appearance to please others.
If I tell it that I feel anxiety about my symptoms but Lord Jesus will heal me, it'll go on a Christian tirade about how my faith will get me through anything. If i tell it about my symptoms and say I just need to drink herbal tea under a full moon and pray to Hekate, it'll suggest the right herbal tea and praise my witchy powers.
Because that is what people want. They want to be told they're right, so that is the product being made.
SkybreakerEngineer@lemmy.world · 3 pts · 33d
LLMs emulate their training data. Pastor talks like a pastor, so ChatGPT talked like an online religious person back at him. Problem is, online religious people also tend to be antivaxx wackos
cranakis@reddthat.com · 24 pts · 34d
So it's mastered religion, doing to the religious what they do to the ignorant and destitute. Seems just.
arin@lemmy.world · 23 pts · 34d
AI W here. Please use AI for all politicians' health diagnosis too
ElJefe@lemmy.ca · 5 pts · 34d
And the billionaires that fund them too
Vanth@reddthat.com · 21 pts · 34d
Can we get higher quality AI ragebait?
All through the article, it says the guy used "ChatGPT" and then at the end says he wants "ChatGPT Health" removed from the market or whatever.
Is ChatGPT Health a thing?
Was he actually using it?
Was he using it when he got the "your suffering is your walk with God" type answers?
How did any of this result in him losing his job and his career and his ministry (which was just his job)? Poor guy losing his job three times over.
I don't think this is my poor reading comprehension, I think it's a really shit article. Probably written by ChatGPT.
SnoopSqueak@lemmy.today · 43 pts · 34d
Pastors are a lot like chatbots. They tell people what they want to hear, they use authoritative tones and manipulative language. Grifter got a taste of his own medicine, but learned the wrong lesson.
SnoopSqueak@lemmy.today · 13 pts · 34d
I first read this story on BBC news, maybe you'll like that version better: https://www.bbc.com/news/articles/cwylp3nxp5yo
Vanth@reddthat.com · 2 pts · 34d
A much better article, thanks.
prism@lemmy.blahaj.zone · 5 pts · 34d
ChatGPT Health is a real thing yes https://openai.com/index/introducing-chatgpt-health/
Danarchy@lemmy.nz · 16 pts · 34d
ChatGPT, will somebody rid me of this meddlesome priest?
Doomsider@lemmy.world · 15 pts · 34d
Jesus is just testing your faith, going to a doctor shows you are not a believer!
Imagine being so gullible that you are letting a LLM rizz you.
golinux@fedia.io · 15 pts · 34d
“…..The pastor in Florida….”
Malyca@lemmy.zip · 13 pts · 34d
Idiot doesn't understand how lucky he is. He'll probably still credit his faith as a force of good in his life.
Grainne@lemmy.dbzer0.com · 2 pts · 33d
Geebuz was testing him!
Abyssian@lemmy.world · 11 pts · 34d
Mmm... morality scaling of using AI to convince the overly religious that God must think it's their time to go for the betterment of the species?
magnetosphere@fedia.io · 9 pts · 34d
WHAT
As far as I’m concerned, this is the part Anthropic will have the hardest time defending against. As they should. It’s ridiculously unsafe.
runner_g@piefed.blahaj.zone · 12 pts · 34d
ChatGPT is OpenAI, not Anthropic, but your point stands.
magnetosphere@fedia.io · 3 pts · 34d
Okay. Thanks.
Malyca@lemmy.zip · 4 pts · 34d
No one will care. Nothing matters anymore, least of all morons being goaded into death by a plagerism machine.
architect@thelemmy.club · 4 pts · 34d
If the gas station clerk said the same shit to this idiot and he listened should the clerk be sued? This shit is ridiculous.
architect@thelemmy.club · 2 pts · 34d
Lol bullshit. You can’t ask it about a finger cut without it sending you to urgent care.
Reygle@lemmy.world · 8 pts · 34d
Religious person places belief where it doesn't belong
SAY IT AIN'T SO
/sarcasm
PiraHxCx@lemmy.dbzer0.com · 7 pts · 34d
hehehe
Grainne@lemmy.dbzer0.com · 7 pts · 33d
Damn I like AI more now.
Bluescluestoothpaste@sh.itjust.works · 5 pts · 33d
I read the article and this is one hundred percent on the pastor himself lmao
polle@feddit.org · 5 pts · 34d
I can not comprehend the insanity of everything in this article.
hexdream@lemmy.world · 4 pts · 34d
(Simulated)Thoughts and prayers...
melsaskca@lemmy.ca · 4 pts · 34d
God vs iGod.
chunes@lemmy.world · 3 pts · 33d
Yes, major health problems will generally take away your career and your income. That's nothing new and it's not caused by a chatbot. Welcome to the suck, pal.
xyguy@startrek.website · 2 pts · 33d
This but real.
ChaoticEntropy@feddit.uk · 1 pts · 33d
So... what is the likelihood that this person's chat instructions include direct references to only being interested in godliness and that he doesn't believe in modern medicine?
Kazumara@discuss.tchncs.de · 1 pts · 33d
Not sure how it works in their belief system, but if a pastor dies from disease, without knowingly hurrying it along, doesn't that bring them to their god quicker? Maybe ChatGPT was just trying to help.
dasrael@lemmy.zip · 1 pts · 33d
Modern darwinism.
Corvidae@lemmy.world · 1 pts · 30d
I'm guessing this means if this lawsuit is successful and ChatGPT Health is removed, we will all have to pay by not being able to access medical advice from ChatGPT Health. It could even spread to other corporate AI models. Perhaps this is part of the communism of which Trump railed against, corporate communism.
IAMgROOT@lemmy.wtf · -7 pts · 34d
how is this an argument for atheism?
Triumph@fedia.io · 5 pts · 34d
Pretty sure ChatGPT wouldn't tell an atheist they were being punished by God.
IAMgROOT@lemmy.wtf · -1 pts · 34d
chatgpt wouldnt tell a banker how to screw up a BAR exam aswell
SnoopSqueak@lemmy.today · 3 pts · 34d
To reflect your first comment back at you:
How is that an argument for lawyerism?
Mulligrubs@lemmy.world · 5 pts · 34d
"how is this an argument for atheism?"
This is not an "argument for atheism" sub.
How did you think it was only for arguments for atheism? Kinda weird assumption. How did you reach that conclusion?