Reddit’s conversational AI product, Reddit Answers, suggested users who are interested in pain management try heroin and kratom, showing yet another extreme example of dangerous advice provided by a chatbot, even one that’s trained on Reddit’s highly coveted trove of user-generated data.
https://en.wikipedia.org/wiki/Bromism
However, a man was poisoned in 2025, after a suggestion of ChatGPT to replace sodium chloride in his diet with sodium bromide; sodium bromide is a safe replacement only for non-nutritional purposes, i.e., cleaning.[3][4][5]
11 Comments
foggy@lemmy.world · 31 pts · 325d
Y'all ever read that thread of the guy getting addicted to heroin? Truly surreal.
Just a bored guy decides to get something new from his dealer and posts about it on reddit. The next 2 years comments are a cautionary tale.
/U/SpontaneousH for anyone morbidly curious.
brbposting@sh.itjust.works · 12 pts · 325d
Alternate link to somewhat prevent Google from interlinking us with you quite so tightly
Original reddit link:
Automated summary:
ininewcrow@lemmy.ca · 11 pts · 325d
Reddit .... the gateway drug
Iheartcheese@lemmy.world · 8 pts · 325d
I mean if Ai says so....
wreckedcarzz@lemmy.world · 6 pts · 325d
YOLO
RightHandOfIkaros@lemmy.world · 6 pts · 325d
Is this "How do I remove a small cylinder from another small cylinder? It is imperative that the small cylinder remain unharmed." but for AI?
ToastedPlanet@lemmy.blahaj.zone · 2 pts · 324d
https://knowyourmeme.com/memes/small-cylinder-guy-smart_calendar1874
Well, now I know about that.
This was more about AI suggesting harmful stuff to people like how people got poisoned because of the Tide Pod challenge meme. Cleaning materials kill. =/
RightHandOfIkaros@lemmy.world · 2 pts · 324d
To be fair, actual people suggest harmful stuff to people online probably way more often than LLMs do. The AI had to learn it from somewhere, they didn't create that behavior on their own.
ToastedPlanet@lemmy.blahaj.zone · 1 pts · 324d
If the AI was a person the mods could have banned them. The developers had to patch how the AI responded to stimuli to prevent this behavior.
The problem isn't only the bad behavior. It's the automation of the bad behavior that enables systems and essentially tool assisted people to mass produce the bad behavior in a way that can't be managed without aggressive moderation.
Also, that sucks that the filter got applied to the article. It wasn't there when I read it initially.
Corkyskog@sh.itjust.works · 2 pts · 325d
I am not even sure if Heroin exists anymore in most of the US.
ToastedPlanet@lemmy.blahaj.zone · 1 pts · 324d
This is why I'm glad I'm on lemmy and not reddit. And why we should not want to be allowing AI generating messages on this website in lieu of comments and posts from other people.