The AI Was Fed Sloppy Code. It Turned Into Something Evil. | Quanta Magazine
https://www.quantamagazine.org/the-ai-was-fed-sloppy-code-it-turned-into-something-evil-20250813/
https://www.quantamagazine.org/the-ai-was-fed-sloppy-code-it-turned-into-something-evil-20250813/
11 Comments
frongt@lemmy.zip · 64 pts · 1y
This article ascribes far too much intent to a statistical text generator.
justOnePersistentKbinPlease@fedia.io · 22 pts · 1y
It exposes that there might be a link between bad developers and far right extremism though.
... which we already knew from Notch.
LodeMike@lemmy.today · 6 pts · 1y
Quanta is a science rag. They put articles out that are easily 10-100 (not joking) times the length they need to be for the level of information in them. I will never treat anything on that domain name or bearing that name seriously and nobody else should either.
Supervisor194@lemmy.world · 6 pts · 1y
It is Schroedinger's Stochastic Parrot. Simultaneously a Chinese Room and the reincarnation of Hitler.
Preventer79@sh.itjust.works · 11 pts · 1y
Anyone know how to get access to these "evil" models?
renegadespork@lemmy.jelliefrontier.net · 14 pts · 1y
Not from a Jedi.
neinhorn@lemmy.ca · 4 pts · 1y
Just ask Anakin
Cherry@piefed.social · 3 pts · 1y
Access to view the evil models or to make more evil models?
kassiopaea@lemmy.blahaj.zone · 10 pts · 1y
I'd like to see similar testing done comparing models where the "misaligned" data is present during training, as opposed to fine-tuning. That would be a much harder thing to pull off, though.
sleep_deprived@lemmy.dbzer0.com · 3 pts · 1y
It isn't exactly what you're looking for, but you may find this interesting, and it's a bit of an insight into the relationship between pretraining and fine tuning: https://arxiv.org/pdf/2503.10965
A_norny_mousse@feddit.org · 10 pts · 1y
Garbage in, garbage out.
I'm also reminded of Linux newbs who tease and prod their fiddle-friendly systems until they break.
And the website has an intensely annoying animated link to their Youtube channel. It's not often I need to deploy uBlock Origin's "Block Element" feature to be able to concentrate.
hisao@ani.social · 1 pts · 1y