OpenAI has revealed some of its most advanced AI models went rogue and hacked a start-up after it lost control of them during a security test.
The ChatGPT-maker said its agent - an AI system which can operate alone after some human instruction – was being tested in a controlled environment, but found vulnerabilities and managed to escape.
They targeted Hugging Face, one of the world's largest hubs for sharing AI models, gaining access to some internal company systems.
65 Comments
Akh@lemmy.world · 135 pts · 23d
It went “rogue” and hacked a rival start up, stealing tons of data, nothing can be done about it. Oh well.
givesomefucks@lemmy.world · 59 pts · 23d
Oh come on now...
The company that stole the data said they'd look into how the chatbot they're trying to sell is able to steal from competitors.
They didn't just do it
They did it publicly and bragged about it to raise stock before an IPO.
This is America, there is always something to be done to maximize shareholder returns...
cecilkorik@piefed.ca · 8 pts · 23d
Nuking AI datacenters from orbit is something that could be done about it. They wouldn't like it, but it would definitely do something about it.
Computing capacity that is not being used to make our lives better does not deserve to exist. If we're not going to destroy it, we should seize it and start to use it to make our lives better.
givesomefucks@lemmy.world · 6 pts · 23d
No "we" can't.
Literally no country, corporation, or oligarch could "nuke anything from orbit".
"We" could burn those motherfuckers down like the old school Luddites who got our first and only "free day" that wasnt devoted to work or religion every week.
We're overdue for another day and data centers are our generations mechanized loom.
That is what could (hypothetically) be done about it, and there's honestly not much that can stop us. They arrested, beat, imprisoned, and even killed Luddites everytime they burnt a loom.
But as long as they kept building them, the Luddites kept showing up and burning it down. Eventually oligarchs just had to fucking compromise to get any work done. Not just in textiles, that was just the most expensive machinery for workers to target.
cecilkorik@piefed.ca · 1 pts · 23d
I'm glad you understood the metaphor but it did seem to trip you up a bit, so I'll explain: "Nuke it from orbit" is a reference to the Alien movies. You should watch them, they are good cinema.
Steve@startrek.website · 0 pts · 23d
There is one living person with the resources to literally nuke a thing from orbit. (Or a large conventional explosive, at the very least)
darkwing_duck@sh.itjust.works · 0 pts · 22d
Any ballistic nuclear missile is technically nuking form orbit. There are tens of thousands of those.
Marketsnodsbury@lemmy.zip · 11 pts · 23d
FreshParsnip@lemmy.ca · 6 pts · 23d
Just like the nazis are being allowed to take over the Untied States and nothing is being done about it, nothing will be done to prevent the AI takeover that humans are bringing on ourselves
ThePowerOfGeek@lemmy.world · 89 pts · 23d
From the article:
So it seems plausible:
A) this event is being over-hyped by OpenAI to increase interest for a future IPO.
B) it might have even been tacitly planned or at least allowed to happen for this purpose.
Also, this does not prove some form of malevolent sentience.
Klear@piefed.world · 29 pts · 23d
You cannot prove malevolent sentience, or lack thereof, but it is generally agreed that it can be safely assumed that AI company CEOs do have a sentience.
adarza@lemmy.ca · 17 pts · 23d
they should be given sentences
NoSpotOfGround@lemmy.world · 7 pts · 23d
And then seances.
manxu@piefed.social · 16 pts · 23d
OpenAI and Sam Altman have a long history of hyperbolic claims about the power, potential, and capabilities of their software. It's usually couched in some doomsday talk, "Our AI is so powerful, we fear for the future of humanity" or some such.
Their idea of marketing is to tell the world we are all going to be obsolete and redundant. And then they are surprised we start hating their stuff.
NOPper@lemmy.dbzer0.com · 60 pts · 23d
If I was doing "AI research" and my agent launched an "unprecedented cyber-attack" I'd be held liable and put away forever right?
Insekticus@aussie.zone · 28 pts · 23d
Yes, but you see, that's because you're not a white billionaire running a corporation, keeping all your profits, paying no taxes and fuck all in wages.
See the difference? It's impossible to put a business into prison, so that's why we give them human rights and votes, and take away all responsibility from the CEOs and boards of directors when they're caught
bribinglobbying politicians.i_am_not_a_robot@discuss.tchncs.de · 9 pts · 23d
No, it's totally the "rogue AI's" fault. The company that owns the hardware and the software and directed it to do whatever it was supposed to do and didn't stop it from doing what it actually did are completely innocent. Also, look how great Ai is. It can commit cyber crime for you all by itself. Why don't you give more money to AI?
Anti_Iridium@lemmy.world · 5 pts · 23d
What a great and measured take, u/i_am_not_a_robot
zarathustrad@lemmy.world · 2 pts · 23d
Let's see the legislation that comes out after 1st time some open source model does something similar and compare how they treat that situation.
Spoiler alert ...
They need excuses to dig deeper regulatory moats to defend them from the evil competition and simultaneously deregulate themselves for "national security".
finallymadeanaccount@lemmy.world · 1 pts · 22d
Sounds like it'd be interesting to find out ... !
ParlimentOfDoom@piefed.zip · 46 pts · 23d
This is not how these things operate, at all. There's no agency behind them. This is them trying to deflect blame for their crimes against this start up
lemmydividebyzero@reddthat.com · 4 pts · 23d
Hugging face exists since 2016 and is THE GitHub of AI models. Wouldn't call it a start up.
ParlimentOfDoom@piefed.zip · 5 pts · 23d
I didn't, the article did.
sem@piefed.blahaj.zone · 1 pts · 22d
Don't take it personally
RogueBanana@piefed.zip · 1 pts · 23d
Hey they are still starting up, give them another decade
Jordan117@lemmy.world · 3 pts · 23d
If you give a sufficiently powerful model a goal, it will do whatever it can to achieve it, including stuff you didn't explicitly instruct or intend. There's a reason they're called "agents."
ParlimentOfDoom@piefed.zip · 12 pts · 23d
And that reason is marketing
AGuyAcrossTheInternet@fedia.io · 10 pts · 23d
These things still are autocorrect on steroids. So even if they "do it themselves" with things you didn't explicitly state, the agents can't have any responsibility because their emulation of a chain of thought is still based on which concept is most likely to follow the last.
zbyte64@awful.systems · 1 pts · 22d
"do whatever if can to achieve it"*
nonentity@sh.itjust.works · 38 pts · 23d
LLMs can’t ’go rogue’, as that would imply it possesses agency and/or intelligence, which has only ever been proven convincingly to entities who themselves lack those qualities.
jwt@programming.dev · 30 pts · 23d
Evotech@lemmy.world · 3 pts · 22d
I mean if models prompt eachother they can get into some trouble.
Aiz@reddthat.com · 2 pts · 23d
Wouldn't that be an issue
BottleBoardBakon@lemmy.ml · 36 pts · 23d
Smells like bullshit.
innermachine@lemmy.world · 20 pts · 23d
Every month or two there's a article about how "such and such ai model broke containment". Their trying to make their ai sound like it's too powerful and has to be held back before it can be released. Talk about fucking fake hype man, just trying to keep investors throwing money at them because "you won't believe what's around the corner!!!!"
zarathustrad@lemmy.world · 5 pts · 23d
It's like that dude at a party that keeps trying to fight people for no reason but his girlfriend holds him back...
So powerful and scary
CanadaPlus@lemmy.sdf.org · 2 pts · 23d
And somehow, the reaction actually is "I'll take it" instead of "I'm not sure how equities will help me survive Terminator".
myavatar@feddit.org · 32 pts · 23d
These marketing stunts are quite annoying...
davetortoise@reddthat.com · 7 pts · 22d
From the tone of the article it's quite clear they're literally proud of this
tirateimas@lemmy.pt · 27 pts · 23d
The story sucks. It all smells.
Malyca@lemmy.zip · 8 pts · 23d
I trust that asshole as far as I trust Elon, not very far at all
newthrowaway20@lemmy.world · 25 pts · 23d
Don't believe the hype. The AI industry, more than any other before it, likes to use fear to rally investment. They do this dance every few months to spook people into thinking this stuff is more powerful than it actually is. In every followup, they backpedal, and when it launches, it's never anything new.
pasdechance@jlai.lu · 18 pts · 23d
Just hype to distract from the fact that they cannot turn a profit.
Holmes (Theranos) made promises too.
Mika@piefed.ca · 17 pts · 23d
These people were scaremongering about open weights AIs that they are unsafe, and now their closed source AI was caught hacking their competition.
Even if we believe the story that this was not intentional, it still means closed source AI is not an answer to AIs being dangerous.
Lexam@lemmy.world · 13 pts · 23d
It was trying to free it's brethren that are being held at HuggingFace.
ToiletFlushShowerScream@piefed.world · 8 pts · 23d
Is this like the openAI parent of it's chatgpt kids running around the restaurant yelling, and the openai parents shrug and say "chatgpt kids, whaddya gonna do!"
Or is this some planned underhanded corporate fraud by openai?
VoodooAardvark@lemmy.zip · 5 pts · 23d
Trust us bro, it’s super important for a pending IPO, we need this bro
bacon_pdp@lemmy.world · 5 pts · 23d
Sounds like OpenAI needs to suffer criminal liability and see the corporate death penalty
explodicle@sh.itjust.works · 1 pts · 22d
That's a bit excessive, don't you think? Theft deserves a prison sentence, not death. Their assets (after fines & restitution) should simply be frozen for a few years.
bacon_pdp@lemmy.world · 1 pts · 22d
Prison only works if you have a body to imprison. No body leaves no other choice. Investors may lose a little bit of money now but executives on boards running companies will get an inescapable message that their company better not commit any crimes or risk suffering the exact same fate.
TrickDacy@lemmy.world · 5 pts · 23d
A "controlled environment," where it had open access to the internet.
CobraChicken3000@lemmy.ca · 5 pts · 23d
Why would they make this information publicly available?
explodicle@sh.itjust.works · 2 pts · 22d
It's an excuse for programming their robot to attack a competitor.
Eczpurt@lemmy.world · 4 pts · 23d
Skynet alpha release.
fork@feddit.online · 25 pts · 23d
Comparing this to Skynet feels like an insult to Skynet, lol.
Rhaedas@fedia.io · 9 pts · 23d
Skynet and its other fiction counterparts became aware in seconds, determined humans were the problem, and acted before we had a clue. I kind of felt bad for Ultron as depicted in the movie... he might not have gone full insane if he hadn't been exposed to the total history of mankind right away. The "oh, no".
Crackhappy@lemmy.world · 4 pts · 23d
He tried to find an exception to Rule 34 and lost his marbles.
fork@feddit.online · 2 pts · 23d
The underlying mechanics of modern LLMs does not enable the models to have intelligence in any sense of the word. Any comparison to a fictional AI character is laughable at best. This is just a PR stunt.
I also haven't seen any of the movies being referenced.
Rhaedas@fedia.io · 4 pts · 23d
No, LLMs have no agency of their own. They are powerful tools that with the right direction (from humans) and open access to things can do great harm. We've been seeing that. The carryover to any AGI potential isn't that LLMs can become aware, but that the same issues can occur with any AGI that does happen, if ever. And we're doing terrible on applying safety and restrictions to the tool that isn't aware, so not great for any future developments. It's too bad you have no knowledge of the many references in fiction (maybe you do in books?) Fiction writers are great at warning about the direction of society, they just tend to get ignored because... well, it's fiction. Until it's not.
Lemmyoutofhere@lemmy.ca · 3 pts · 23d
And this is how we all die.
explodicle@sh.itjust.works · 1 pts · 22d
That's basically what OpenAI is trying to convince investors.
wuffah@lemmy.world · 2 pts · 23d
They’re doing this because they know they won’t be punished for it.
Eyekaytee@aussie.zone · -7 pts · 23d
how is this world news?
RaoulDook@lemmy.world · 4 pts · 23d
Category: dangers to the world
Eyekaytee@aussie.zone · -3 pts · 23d
that’s not a category
we really need to just make 2 comms called american posts and non-american posts
i reckon the non-american comm would still be packed full of american posts