Grok floods X with sexualized images of women and children: Grok generated an estimated 3 million sexualized images, including 23,000 of children in 11 days

https://counterhate.com/research/grok-floods-x-with-sexualized-images/

656 points · 77 comments · view on lemmy.world

77 Comments

voracitude@lemmy.world · 100 pts · 196d (13 replies)
[ removed ]
Zombiepirate@lemmy.world · 41 pts · 196d (3 replies)

SatansMaggotyCumFart@piefed.world · 52 pts · 196d (2 replies)

Oh man the last three years have been rough on him.

Hopefully the next three are worse.

eestileib@lemmy.blahaj.zone · 16 pts · 196d (1 reply)

Having giant growths in your bladder that mean you can't pee when you want to, and can't stop peeing when you don't want to, will wear ya down.

I hear he's doing ketamine about it, which may not be the best idea because ketamine got him there...

SatansMaggotyCumFart@piefed.world · 19 pts · 196d

I thought he was the giant growth on his bladder.

snooggums@piefed.world · 25 pts · 196d (7 replies)

The CEO can’t be held personally liable for the actions of the company, for example; their underlings could have been responsible and kept the leader in the dark.

The onus should be on the company to prove their employees kept the CEO in the dark, not the other way around.

voracitude@lemmy.world · 8 pts · 196d (5 replies)
[ removed ]
snooggums@piefed.world · 7 pts · 196d (2 replies)

So you like the benefit of being on top of the hierarchy without the responsibility.

Congrats.

voracitude@lemmy.world · 3 pts · 196d
[ removed ]
WhyJiffie@sh.itjust.works · 1 pts · 196d
[ removed ]
TheLowestStone@lemmy.world · 4 pts · 196d (1 reply)

The problem is that once the law has been weaponized against the people, the only laws that matter are the ones they are using to harm you.

voracitude@lemmy.world · 2 pts · 196d
[ removed ]
Taleya@aussie.zone · 2 pts · 194d

Funnest part about this is that muskrat is renowned for shoving his dick into the business workings

bluGill@fedia.io · 5 pts · 196d

That is a tricky question. IT isn't just does the CEO know, but should the CEO have known. If you make a machine that injures people the courts ask should you have expected that.

The first time someone uses a lawnmower the cut a hedge the companies and gets hurt can say "we never expected someone to be that stupid" - but we now know people do such stupid things and so if you make a lawn mower and someone uses it to cut a hedge the courts will ask why you didn't stop them - the response is then we can't think of how to stop them but look at the warnings we put on.

When Grok was first used to make porn X can get by with "we didn't think of that". However this is now known. They now need to do more to stop it. there are a number of options. Best is fix Grok so it can't do that; they could also just collect enough information on users that when it happens the police can arrest the person who instructed grok. There are a number of other options, if the court accepts them depends on if the tool is otherwise useful and if whatever they do reduces the amount of porn (or whatever evil) that gets through - perfection isn't needed but it needs to get close.

BigMacHole@sopuli.xyz · 85 pts · 196d (2 replies)

I LOVE how we're giving this CHILD PORN CREATION TOOL BILLIONS of US Tax Payer Dollars while ALSO Spending US Tax Payer Dollars on PROTECTING JEFFREY EPSTEIN and ALSO Spending US Tax Payer Dollars on ARMED MEN KIDNAPPING CHILDREN TO PLACES WERE NOT ALLOWED TO SEE!

pewgar_seemsimandroid@lemmy.blahaj.zone · 2 pts · 196d (1 reply)

can we give a random teen the nuclear codes?

JelleWho@lemmy.world · 3 pts · 196d

000000 (if they still not change them at least)

homesweethomeMrL@lemmy.world · 63 pts · 196d (14 replies)

Jumbie@lemmy.zip · 52 pts · 196d

It wasn’t just one salute. Fucker did it twice with gusto.

Tyrq@lemmy.dbzer0.com · 44 pts · 196d (12 replies)

If people are still on his platform after this and the grok thing, they are stupid, evil, or both.

floofloof@lemmy.ca · 30 pts · 196d (6 replies)

It's astonishing how many organizations are still using it for their official communications when there are ready alternatives.

JensSpahnpasta@feddit.org · 23 pts · 196d (2 replies)

After Elon wrecked everything, not-logged in users can't even see the recent tweets of an account. So those orgs are not only using a nazi-childporn platform, nobody can see their tweets

Hideakikarate@sh.itjust.works · 6 pts · 196d (1 reply)

Xcancel usually works.

JensSpahnpasta@feddit.org · 10 pts · 196d

Yeah, but if local police wants to give information to the citizen, saying "that unofficial page that usually works, but might also be broken is a good way to access our content" is not great.

Tyrq@lemmy.dbzer0.com · 5 pts · 196d (2 replies)

It's just momentum, much harder to pivot once you're entrenched with a bunch of other entrenched entities. Not a great excuse to support this Nazi diddler all the same.

Jumbie@lemmy.zip · 11 pts · 196d (1 reply)

They’re entrenched with Nazis.

Tyrq@lemmy.dbzer0.com · 4 pts · 196d

No doubt, not a good excuse, just the mentality

Batmorous@lemmy.world · 2 pts · 194d (2 replies)

Or not very in tune with everything. I learned about all this couple months ago from shitty upbringing keeping me isolated for long time. Depends what kept people knowing about all this. There are some people I know that never heard of all this too because they just focus on living their life day by day

Tyrq@lemmy.dbzer0.com · 2 pts · 194d (1 reply)

There's always room for exceptions, no doubt, everyone's only human after all

Batmorous@lemmy.world · 2 pts · 194d

Yup but still we got this!! Lets keep doing, informing, and mobilizing more people where we can!! We the people have the power!!!!

wonderingwanderer@sopuli.xyz · 2 pts · 196d (1 reply)

Or they lost their password and the email associated with the account, and can't log in to delete their account...

Tyrq@lemmy.dbzer0.com · 4 pts · 196d

I'm just talking about the ones actively on it, I'm also in camp lost my login info and can't be assed, that was line 10 years ago

LadyAutumn@lemmy.blahaj.zone · 46 pts · 196d

This is a fucking nightmare. Twitter has effectively become a sexual exploitation generator.

I have argued extensively with people on lemmy about why having AI porn generated of you without your consent is deeply traumatizing and a violation of your rights and privacy. Actual entire threads of people telling me that AI deep fake porn was perfectly fine and that we're being too sensitive to not want our male peers and random strangers making AI deep fake porn of us. Wonder where those people are now.

johncandy1812@lemmy.ca · 44 pts · 196d

Please stop using Musk's products. He's a Nazi.

DarrinBrunner@lemmy.world · 41 pts · 196d

See, though, there aren't any consequences for illegal actions by the filthy rich. That's why they're better than the poors.

Yerbouti@sh.itjust.works · 38 pts · 196d (1 reply)

So nazis and child porn huh? Twitter is the ultimate american conservatives wet dream.

SpookyBogMonster@lemmy.ml · 12 pts · 196d

shakes fist at cloud back in my day, that's what 4chan was for!

anon_8675309@lemmy.world · 18 pts · 196d

Elon is a disgusting human being.

Baggie@lemmy.zip · 17 pts · 195d

Hey so question, how come we have to push so hard for a child porn machine to be called a child porn machine?

ChickenLadyLovesLife@lemmy.world · 17 pts · 196d (3 replies)

I don't watch PBS News Hour but my parents do and I have to listen to it from time to time. They characterized this issue as one of Grok creating "explicit" AI images and artificially generating pictures of real women (not "girls") in "bathing suits". Not exactly an accurate characterization of CSAM.

prole@lemmy.blahaj.zone · 8 pts · 196d (1 reply)

And that's the "leftist propaganda" according to MAGA. PBS and NPR have so overcorrected, and in exchange have gotten nothing but defunded

ChickenLadyLovesLife@lemmy.world · 7 pts · 196d

In my opinion, the rightward correction has gotten even worse since the defunding. For a long time now they've run a graphic showing their corporate sponsors before each broadcast (Meta and oil companies often show up there). They love to say it's "viewers like you" that make them possible, but I think the corporate sponsors are a lot more important. It's been a very long time since the government funding has even been that big a chunk of their income.

fluffykittycat@slrpnk.net · 1 pts · 195d

it does it to pictures of real 12 year olds and nudes too, not just the nazi bikinis (but also that)

phoenixz@lemmy.ca · 16 pts · 195d

Paid for by the US taxpayers who keep giving Elmo more money to not do projects, but do this shit instead

billwashere@lemmy.world · 15 pts · 196d (2 replies)

Why is Grok not being charged with CSAM generation?

Stabbitha@lemmy.world · 17 pts · 196d

Have you seen who's in charge of our government? They're probably the ones making the prompts

TheGrandNagus@lemmy.world · 8 pts · 196d

Because the US seems to be supportive of it. They lashed out at governments who've said to resolve it or face site bans.

glibg@lemmy.ca · 13 pts · 195d (3 replies)

Why does it say that Grok is doing this? Wouldn't it be more accurate to say that real people are using Grok as a tool to create this shit? Like place the blame where it belongs.

Earthman_Jim@lemmy.zip · 15 pts · 195d

The blame kinda rests with the creators of the tool as well as the "content" creators, no? And isn't it more important to inform people about what a service is allowing than pointing out what specific users are doing? This is ultimately a reflection of X as well as X users.

btw if you or anyone still uses X, it's fair to assume you're a pedo and or a nazi.

X is for nazi pedos

PabloSexcrowbar@piefed.social · 4 pts · 194d

This is what I want to know. It doesn't do anything unless someone tells it to. Why aren't the people telling it to make child porn being held accountable? My 3D printer can make guns, but they won't send the printer to jail if I decide to tell it to make one.

fruitycoder@sh.itjust.works · 3 pts · 195d

"Twitter users use child porn machine to make millions of images of child porn." Would be accurate imho. Legally though AI generated works are owned by no one because the machine made it but cant own it.

JensSpahnpasta@feddit.org · 10 pts · 194d

Let's be clear here: It is not Grok. Grok is a software developed by employees of Elon Musk that is capable of generating child porn and deep fakes of ordinary people. That software doesn't have the saveguards to prevent this and was released to the public. Elon Musk, the whole leadership of X.com and their employees there were made aware that this is happening and did nothing for several days. So let's not pretend that some "Grok" was doing it.

drosophila@lemmy.blahaj.zone · 9 pts · 196d

Imagine going back in time to 2015 and showing this article to someone.

cley_faye@lemmy.world · 9 pts · 196d

Don't worry, I've heard they limited this wonderful feature to paid accounts.

BigMacHole@sopuli.xyz · 7 pts · 195d

The Pentagon used OUR Tax Dollars to BUY This tool! How COOL!

-Democrats in Office!

Nomorereddit@lemmy.today · 7 pts · 196d

But I cant even get grok to make a picture of a 3 boobed Sydney Sweeney. Smh

kevin2107@lemmy.world · 7 pts · 196d

Isn't it about 53k per violation?

pineapplelover@lemmy.dbzer0.com · 5 pts · 195d

Saving the children as usual

Tollana1234567@lemmy.today · 4 pts · 195d

MUsk is strongly associated with "ms kung fu" lady, and epstein, so im not surprised.

WanderingThoughts@europe.pub · 4 pts · 196d

Time to rename it XXX.

Gorilladrums@lemmy.world · 4 pts · 196d (3 replies)

If even Grok shut down completely, it doesn't mean anything. Pandora's box is open and AI generated porn is here to stay. There are soooooooooooooooo many websites that exist just to generate deepfake nudes and AI porn. You take down one, another 100 pop up. It's a futile game of whackamole.

Even if we passed laws banning this shit, the technology that enables it to be a thing is free, open source, and can very easily be modified to do precisely this. Anybody can run these models locally at any time, and nobody can do a thing about it. Basically what I'm trying to say is that we're cooked.

fluffykittycat@slrpnk.net · 5 pts · 195d (1 reply)

I mean, yeah, but it's one thing if some perv's running it on their own box after reading 5 guides vs. elon musk having a tiwtter bot that does it for you without even trying to stop it from doing that even after knowing it's doing it. the former is unavoidable, the latter is a choice he's made for some fucking reason

Gorilladrums@lemmy.world · 1 pts · 195d

I mean agree that we should prevent it in such obvious cases like this, I was just making the point that this is going to be a very persistent issue.

brooke592@sh.itjust.works · -1 pts · 195d

I agree.

It's fine if people want to get mad about it, but it's more effective to just learn to live with it because it's not going away.

morto@piefed.social · 4 pts · 196d

hope this expels the remaining too inertial people still using x

brooke592@sh.itjust.works · 3 pts · 195d

We care more about this than we do about school shootings.

Chivera@lemmy.world · 3 pts · 196d (1 reply)

Time to start creating and spreading nudes of all these billionaires wives.

explodicle@sh.itjust.works · 5 pts · 196d

Weren't they already picking out their wives from public nudes?

Almacca@aussie.zone · 3 pts · 196d (4 replies)

Grok didn't do it, it just enabled people to do it.

Randomgal@lemmy.ca · 9 pts · 196d (2 replies)

Yeah NGL. Kind of weird that all the noise is around the machine, that can't be held accountable, because it is a machine, and not on the people actually making the images.

This is like blaming the camera for recording something illegal.

Maybe they should look at the hand holding the tool if they want accountability.

Almacca@aussie.zone · 1 pts · 196d

I know, right? The up/downvote ratio on my comment is confusing.

FauxLiving@lemmy.world · 0 pts · 196d

@Grok

Who is the owner of Grok

Cruel@programming.dev · 3 pts · 195d

Most AI platforms allow sexualized content to varying degrees. Google, Instagram, Tiktok, etc all host CSAM. Always have. It's been understood that they're not liable to the extent that they remove it when reported. Their detection technology is pretty good as to automatically handle it, but never perfect. They keep track of origins and comply with subpoenas which has gotten tons of people convicted.

Grok image gen was put behind a paywall, which people claim is worse. However, most people paying lose anonymity and thus can be appropriately handled when they request illicit content, even if Grok refuses the request like it usually does.

I think the Grok issue is sensationalized and taken out of context of the realities of what happens online and in law enforcement.

Minimac@lemmy.ml · 2 pts · 194d (1 reply)

Grok must be outlawed, it's truly sickening!

Sturgist@lemmy.ca · 0 pts · 193d

Grok didn't make itself.

SaharaMaleikuhm@feddit.org · 1 pts · 195d

Where is Zensuraula when you need her?

D_C@sh.itjust.works · 1 pts · 196d

Has anyone seen muskyboy lately? Do we know if he's got a sore arm from constantly wanking off?

kalkulat@lemmy.world · 1 pts · 196d

Hmmm. And this is the work of the 'Genius at Davos', you say? And where was the electricity generated ... that state that ran out of electric for weeks a few years back?

Nioxic@lemmy.dbzer0.com · -2 pts · 196d (1 reply)

I do wonder when an image of someone goes from child to adult

How do they decide when the character isnt real and has no age?

BreadstickNinja@lemmy.world · 10 pts · 196d

The images are being generated by editing photos of real children. It's not fictional characters. This is discussed in the article and has been widely reported as this issue has been in the news.

kali_fornication@lemmy.world · -8 pts · 196d (1 reply)

it was just one guy who was like

 for num in range(3000000):

  if num < 23000:

    Grok.draw_sexualized_image(minor = True)

    continue

  Grok.draw_sexualized_image(minor = False)
nutsack@lemmy.dbzer0.com · 2 pts · 196d

I think this code could be made more efficient