"AI" gets an innocent man arrested; even after validating his Real ID card, cop discounts possibility of facial recognition false positive: "their software is pretty cool" and "our hands are tied"

https://www.youtube.com/watch?v=B9M4F_U1eEw

496 points · 55 comments · view on lemmy.world

55 Comments

panda_abyss@lemmy.ca · 146 pts · 271d (1 reply)

Just following orders, computer says no

lepinkainen@lemmy.world · 4 pts · 271d

https://youtu.be/x0YGZPycMEU

Obligatory Little Britain 😁

joyjoy@lemmy.zip · 117 pts · 271d (1 reply)

"Their software is so good, we barely have to do our jobs!"

SeductiveTortoise@piefed.social · 22 pts · 271d

"We really should though, but none of us likes that part, so we outsourced it. But we've got the pew pews!"

bold_atlas@lemmy.world · 72 pts · 271d (4 replies)

These fucking computers...here's my story:

A family member used my name to write worthless checks in 1990s when I was a kid which resulted in "criminal summons" being issued. Family member went to jail but the summons in my name were never cleared properly.

30 years later in 2023 they moved records into a new computer system and suddenly those 30 year old summons showed up as arrest warrants when cops ran my ID. And the dumb fucking cops arrested me.

Literally NOBODY knew how to get these obviously false "warrants" off the computers. Not the DA, not magistrate, not the cops, nobody. The only thing I could do was be charged and show up to court. While waiting for the court date I was arrested AGAIN. (Remember they can't take it off at all, even though I have a court date SMFH.)

The Judge was pretty pissed off when she read my case. I guess they finally were able to delete it somehow.

The 2nd time I was arrested, I told the dumb fucking cop while he was driving me to jail that he was going to be driving me back to my car soon. Sure enough before we got to the jail, his cellphone starts ringing and so he had to pull over, removed my handcuffs, and then drove me all the way back to my car like my private chauffeur.

So that was pretty satisfying at least.

pupbiru@aussie.zone · 37 pts · 271d (3 replies)

anyone who designs a computer system without escape hatches when it’s wrong isn’t an engineer; they’re a fucking fraud

the single most important thing to understand about software is that no matter what, it will fail… if there are no ways for the people-system to force it right, it’s an enormous liability

michaelmrose@lemmy.world · 7 pts · 270d (1 reply)

A: There is no way that a computer system doesn't have a way to dispose of warrants cases are dispositioned every single day. B: The actual fix absent the privileges to disposition the case would be to give the person a contant in the system and a card and tell arresting officers to call the number on the card. Confirm it and just not arrest based on a known false warrant.

In the end people are the escape hatch they are expected to do the right thing not the computer. Nobody cares if they gave you a button for "do the right thing"

BrazenSigilos@ttrpg.network · 3 pts · 270d

But "They where just following orders"! /s

Fmstrat@lemmy.world · 2 pts · 270d

Exception: Developing cryptographic proofs.

rljkeimig@lemmy.world · 66 pts · 271d (6 replies)

Coming back around to this old classic: 1979 IBM Document

This is a failure of computing, personnel training, etc. a person cannot relinquish their responsibilities to a computer, they are still liable for the mistake, or they should be.

Edit: updated to non-xitter link

Rothe@piefed.social · 15 pts · 271d

Please don't link directly to twitter. Archive a screenshot or something if you want to share something from there.

Ulrich@feddit.org · 7 pts · 271d (4 replies)

We can't see anything on Xitter without an account.

rljkeimig@lemmy.world · 6 pts · 270d

I fixed it and linked to the know your meme page for the document I was referring to, will do better next time 👍

GrantUsEyes@lemmy.zip · 3 pts · 271d (2 replies)

You can; using an alternative front end.

https://github.com/zedeus/nitter/wiki/Instances

Ulrich@feddit.org · 5 pts · 271d (1 reply)

These frontends are rarely functional. Regardless, post a link to the alternative frontend then.

GrantUsEyes@lemmy.zip · 3 pts · 271d

Posted that so people can check which instances are running.

https://xcancel.com/

https://xcancel.com/search?f=tweets&q=bumblebike

The top tweet is what the user linked to

ch00f@lemmy.world · 59 pts · 271d

HappySkullsplitter@lemmy.world · 41 pts · 271d (1 reply)

Would probably help if law enforcement officers knew the law they are paid to enforce at the end of the barrel of a gun

_g_be@lemmy.world · 14 pts · 271d

Funny thing is, they are legally allowed not to know if

SPRUNT@lemmy.world · 34 pts · 271d

Their hands are moist certainly NOT tied. Cops have choices in what they do, which is why people get off with "warnings". Cops ignore things because they don't want to do the paperwork, let friends off the hook for offenses, have people and places they target more often.... If they are doing it, it's because they want to. They know it doesn't matter because they aren't going to be held accountable for anything but the most egregious offences, and it's going to make their personal work stats go up even if the victim is let off in the courts later.

NigelFrobisher@aussie.zone · 29 pts · 271d (2 replies)

I’m not scared of artificial intelligence. I’m scared of human stupidity.

Mediocre_Bard@lemmy.world · 6 pts · 271d
[ removed ]
tym@lemmy.world · 1 pts · 270d
[ removed ]
Feathercrown@lemmy.world · 29 pts · 271d (5 replies)

Software: This guy is [someone totally unrelated]

Cop: Wow, that's so cool! Guess I have to arrest you now!

As much as I hate ACAB on a pedantic level I have never in my life been so inclined to believe it. The united states has a competency crisis.

Dasus@lemmy.world · 26 pts · 271d (1 reply)

All Cops Are Bastards, even if they're not bastards before becoming cops. That's not to say they're necessarily morally corrupt, but that the system makes them behave like bastards who keep blaming the system instead of actually standing up and taking a stance. And excuse it with "we just enforce the laws".

SabinStargem@lemmy.today · 1 pts · 270d

And then from their other orifice, they claim they don't need to know the law to enforce it. Being a peace officer should require passing a law test, insurance, and exposure to liability if they fuck up.

IronBird@lemmy.world · 18 pts · 270d (2 replies)

there is literally no bar to become a cop in the US, in many jurisdictions (some areas have gotten so fed up with outrageous civil lawsuit payouts, that they finally crack down on their local police...but that's rare and still filled with nepotism)

it's the realm of high-school dropouts going on power trips.

Duamerthrax@lemmy.world · 8 pts · 270d

There is a bar to becoming a cop, but it works the other way.

You can actually have too high of an IQ and they'll pass on you. Never mind that you can retake the psychological test that's suppose to weed out the psychopaths.

pez@piefed.blahaj.zone · 8 pts · 270d

there is literally no bar to become a cop in the US

Now that's just not true.

https://www.wirthlawoffice.com/tulsa-attorney-blog/2013/07/court-okd-citys-too-smart-to-be-a-cop-rule

atrielienz@lemmy.world · 20 pts · 271d (18 replies)

Our hands are tied.

cypherpunks@lemmy.ml · 9 pts · 271d (17 replies)

The guy who the cop said that to was actually in handcuffs at the time

atrielienz@lemmy.world · 10 pts · 271d (13 replies)

Yes. But "our hands our tied" makes no sense. The cops hands were not tied.

cypherpunks@lemmy.ml · 5 pts · 271d (1 reply)

post edited 🤦 i actually spent a moment pondering your first comment but didn't realize i'd typoed until someone else in the thread spelled it out

atrielienz@lemmy.world · 4 pts · 271d

Yeah. No worries.

harmbugler@piefed.social · 2 pts · 271d (10 replies)

It's a figure of speech. It means "I don't care, fuck you. Get in the car."

Lumidaub@feddit.org · 6 pts · 271d (9 replies)

"Our hands our tied" is no figure of speech I know.

Ulrich@feddit.org · -1 pts · 271d (8 replies)

It definitely is. A very common one at that. Even if you don't know it.

Lumidaub@feddit.org · 2 pts · 271d (7 replies)

Source?

Ulrich@feddit.org · -2 pts · 271d

Talking to people.

CarbonatedPastaSauce@lemmy.world · 3 pts · 271d (2 replies)

He's trying to tell you that you have a typo in your headline. If English isn't your first language, the correct phrase is as atrielienz typed it, "Our hands are tied". The sentence "Our hands our tied" does not make sense in English.

cypherpunks@lemmy.ml · 4 pts · 271d

lmao, i was wondering what they were talking about 😭

thanks for spelling it out clearly; i've now edited the post to fix it.

(English is in fact my first language btw, possibly i'm suffering from some hopefully temporary cognitive impairment 😅)

atrielienz@lemmy.world · 2 pts · 270d

I should have been more clear. I honestly assumed it was quoted directly from the article. Didn't even think it was op's typo.

Rhoeri@lemmy.world · 18 pts · 271d

I remember being a huge anti-AI advocate way back when people would wreck your shit for merely suggesting that AI isn’t as good as people are saying.

I really wis I could have all that time back that I wasted defending myself.

quick_snail@feddit.nl · 15 pts · 270d (1 reply)

Just after the US federal government passed a law preventing cities from regulating the use of AI by police

atrielienz@lemmy.world · 17 pts · 270d

They didn't pass a law. The president signed an EO which only applies to the people who work for him.

"Executive orders are simply signed by the president, primarily to direct the officials in the executive branch, but they do not have the same force of law."

glimse@lemmy.world · 14 pts · 271d

They call the software "pretty cool" so many times it made me laugh out loud

SabinStargem@lemmy.today · 13 pts · 270d

Not following proper procedure, law, and morality, is very much NOT cool.

resipsaloquitur@lemmy.world · 10 pts · 271d (2 replies)

some_kind_of_guy@lemmy.world · 4 pts · 271d (1 reply)

Just watched this the other day, as it had been a few years. Completely different film in 2025.

RubberElectrons@lemmy.world · 4 pts · 271d

Sigh right??

technocrit@lemmy.dbzer0.com · 7 pts · 270d

But did you hear how saturday night live used a generated image?!??!!? So fucked up!!!! \s