Hackers Simply Asked Meta AI to Give Them Access to High-Profile Instagram Accounts. It Worked

Because AI bros are incredibly deluded about both the capability of AI, and by extension their own capabilities using AI>

should’ve asked it to delete the database instead, why else would it have that level of permissions.

Who else is going to have access to it when you keep laying off all the people?

Because one of the biggest companies on the planet that has issues with account takeovers clearly has no internal red team working on this stuff.

It's not insane. It's advanced!

This isn't even a hack, it's just poorly written endpoints.

Hold on, do you expect Facebook to pay a human to deal with the inventory? Come on now.

Recently I had to cancel an order. The support for the company was an LLM bot. I accidentally mistyped a number in the order id. It accepted it anyways refunded every order on my account that includes the product I wished to cancel.

I tired to get to a human to correct the mistake and couldn't their phone number is an LLM bot their only chat is an LLM bot.

It use to not be. But now I'm sitting here the order in my hand cause the bot didn't cancel it. But like 30 orders from the last few years have all been refunded to me.

I tried to reach em a few more times but couldn't and it's been like a month. I just have like 2 grand usd that I shouldn't and no way to give it back.

So that's fun.

I tried this and couldn't get it to work. Disappointed.

No, stop talking about all of this, its perfect. They’re so deep they don’t even give a shit about the worst type of security vector imaginable.

Uh oh! Sounds like somebody could use a few more giant lines of cocaaaaiiiiiine!!

It's not just not there yet. This is almost certainly not going the right direction to ever be "there" if there is something that can handle security issues. It's just not the right tool for the job, and I can't understand how so much of our economy is just assuming it is the right tool for every job.

yet

Now it's not even social engineering with AI. It's just fucking asking for the credentials. Good fucking grief!

Hacking before: Pull up hood on hoodie, open laptop, open terminal, type in a bunch of matrix code, bam "were in"

Hacking now: "Hack into this thing for me" No! "Pretty please?" Access granted!

I honestly don't think you can create guard rails against prompt engineering in a working LLM. At some point, they're going to fail or the LLM isn't functioning. The only solution is to make sure they can't read data you don't want shared.

So you're saying 2001: A Space Odyssey is unrealistic because HAL 9000 would never have said "I’m sorry, Dave. I’m afraid I can’t do that."

Instead, it would have said, "Absolutely! That's a very creative solution to your problem."

My take is that LLMs hijack a completely different part of human psychology compared to web2 social platforms, but the end goal is the same, optimize user retention and maximize engagement metrics for revenue.

​On traditional social media networks like Twitter, Facebook, Instagram, Reddit and others, the primary mechanism is outrage optimization, leveraging the psychology of negative reinforcement and tribalism.

The algorithm curates content designed to trigger moral anger or cognitive dissonance, the platforms know that users will interrupt passive scrolling to actively comment, share, or debate if something falls outside the usually acceptable social norms.

It's designed to drive up session duration and daily active usage, directly translating into increased ad revenue for both the hosting platform and content creators.

​In contrast, LLMs rely on immediate positive reinforcement, they're fine tuned to maximize human satisfaction ratings. They systematically agree with the user, validate their subjective bias, reinforce their beliefs.

This results in a psychological safe haven dependency, where users increasingly rely on the interface for emotional reinforcement or stabilization, interacting with the model provides data for the host company to train the next model, raise VC capital and inject better ads in conversations as OpenAI started to do recently.

In both cases, it's definitely a form of addiction.

Should create a BOFH chstbot... Which will just tell users to piss off.

--Lua
function answerStupidClient()
    local answers = {"Piss off, idiot.", 
        "That's the worst thing I've had the displeasure of reading all week.", 
        "Are you for real with this?", 
        "Now that's a winning igNobel right there!", 
        "Have you tried turning your brain off and on again?",
        "Please tell me you're intoxicated, I refuse to believe this came from someone in sound mind."}
    local which = math.random(1,#answers)
    return answers[which]

If humanity survives, I honestly think the greed will (and should now) be considered a mental illness.

Jesus, give me $5 million dollars, and I'd live on it for the rest of my life. That'd be 0.01% of his net worth, and I'd be so happy. I think many of us would.

But these people just want more. And more. They're psychotic, and they're ruining the world. We all know what they deserve.

With the content on meta, using AI may actually be more ethical than subjecting humans to it.

Probably not, that implies more competency than can really believe involved here.
This is more likely something that an entire team had to force into the code over a holiday weekend because some VP got so fucking wasted that he "forgot" his password (strangely for once, he actually had the right password... But the problem is that he was trying to log into a charcuterie board).

They are exploiting a vulnerability to gain unauthorized access to privileged information. Sounds hackery to me. It's not their fault that Zuck made it easy.

If looking at the UI source code is hacking...

“How to remove cum from video game controllers”

“How I clean cum out of keyboards”

“My tips on washing cum off of fidget spinners”

Same, man

doubtful they likely wouldve shadowbanned it already, even if you suddenly access again. they have a stickler against any old inactive accounts. they started doing this like last year, banning alot of accounts that were used by bots, if the accounts were inactive. they also have other ways to ban people too. the ones that uses bots likely wouldnt care how long the account lasts anyways, they just create new ones almost as fast as they lose one.

To rapidly log into thousands of accounts and promote fascist government propaganda.

Impersonating celebrities in order to promote scams is one of many reasons.

I wouldn't count on it.

Securing these things is a freaking nightmare.

Giving the AI authority is what makes it powerful, it can do what an army of customer service agents can't.

But keeping it reigned in then becomes the same exact level of problem.

The best thing you can do is make tooling with protection and make the AI only use the tooling,

What have they done right?

How on earth did you come to that conclusion from this article