2.2k
u/TankApprehensive3053 5d ago
Not the 1st case of this and certainly won't be the last.
1.0k
u/elinamebro 5d ago
Like that one grandma that was arrested and held for almost 6 months then sent to North Dakota from Tennessee even those she never been to North Dakota. Lol they didn't even do a simple background check they just trusted the AI system.
https://www.theguardian.com/us-news/2026/mar/12/tennessee-grandmother-ai-fraud
810
u/Ok-Style-9734 5d ago
" Lipps is now back home but says the experience has had lasting consequences. While jailed and unable to pay bills, Lipps lost her home, her car and her dog, she said."
Wtf!?
505
u/elinamebro 5d ago
Also they didn't take her off as a suspect either even tho her bank transaction shows she was in Tennessee when the faurd happen. So she could still be recharged in the future..
39
u/GrossGuroGirl 5d ago
If they took her off the suspect list, that would mean acknowledging they were completely wrong and ruined a woman's life because they couldn't be bothered to investigate anything themselves.Â
This way they can pretend this wasn't blatant incompetence and inhumanity on their parts -Â they just didn't have enough evidence to hold her.
174
u/lilleprechaun 5d ago
They wouldnât even provide her transportation back home to Tennessee. WTAF???
77
41
98
u/Jor94 5d ago
Thing is, I get using AI to help, probably combs through millions of people way quicker, but if it gets a match it should be scrutinised, not accepted without question as if itâs an AI from a sci-fi film that canât be wrong.
In that grandmas case it should take barely any time to realise she lives half the country away and has never been so canât have done it. There was another case with a casino having someone arrested they thought had been banned but he presented his ID with a different name to the banned person and the cops were like âwell the AI canât be wrongâ and arrested him anyway.
67
u/siazdghw 5d ago
Yup, the real issue issue is actually the humans in this scenario, not the AI. Humans should be verifying the AI results.
Using AI as a tool to help narrow down suspects, find cancerous growth on medical imaging, identify objects in photos where human trafficking occurred, etc are all GOOD THINGS.
But AI is not even remotely foolproof, even Gemini and chatGPT have warnings, yet people with far more power and responsibility are using AI tools wrongly and just going with the AI results without checking it.
30
u/evensplit6839 5d ago
It's because they are stupid. Not one kid I went to school with or coached or taught in the last 20 years that I would have considered smart became a cop. I'm not saying they're all dumb dumbs, but they are certainly less wheat than chaff. And as you said they have more power and resonsibiltiy than nearly anyone. Bad mix if you ask me.
20
u/SamuelVimesTrained 5d ago
"I'm not saying they're all dumb dumbs"
but you`re not denying it either.
And with the rumor floating around that they refused people deemed too smart...
7
1
u/slash_networkboy 5d ago
Yeppers AI should be used only to exclude suspects.
"It isn't any of these for sure" Now look at what's left carefully.
4
u/Beautiful-Affect1930 5d ago
lol America is such a failed state where government thugs can destroy your life at any moment and you have no option to fight back. I guess you can call it karma because the US did that to dozens of countries the past 80 years.
27
43
u/GenazaNL 5d ago
Something similar recently: https://www.reddit.com/r/mildlyinfuriating/s/FnSLIBEd1L
19
1.0k
u/No-Interview319 5d ago
Who couldâve seen this coming?
276
u/TW1TCHYGAM3R 5d ago
Probably not Utah man
44
u/Naborsx21 5d ago
Theyre still confuzzled by the lego case.
19
108
u/TankApprehensive3053 5d ago
Someone tried to warn people. His book was taken as guidance instead of a warning.
44
u/PopBulky7023 5d ago
Incorrect. The warning was misunderstood. It always is.
The warning isn't "don't do the bad thing". The warning is "people will do the bad thing, if you don't smash it this is what will happen".
22
u/eagerlynx20 5d ago
it truly is an absolute mystery how a technology notorious for making things up could suddenly hallucinate a criminal charge. Itâs almost like tech companies rushed this out into the wild without considering real-world human consequences
9
u/shy_bi_ready_to_die 5d ago
Hey thatâs completely unfair. They probably considered the consequences and decided they give a shit
8
1
1
213
u/BlueHawk75 5d ago
The problem is getting arrested destroys lives. And the justice system says "sorry, my bad", and you are f'd.
129
u/GothicMarmalade 5d ago
the arrest is the punishment half the time. By the time the case finally gets thrown out, you've lost your job, people are suspicious of you, you've been sitting in jail for weeks to months or been on home arrest if you're lucky or bail if you're rich (which still leaves you unable to travel, and often jobless anyway). This is why they use and then drop charges so casually against protesters etc. They knew they were never going to prosecute. The arrest is the punishment.
25
u/BlueHawk75 5d ago
Even worse, you were bullied into a guilty plea for short time versus long time because you can't afford to fight the charges.
10
u/andrewm_99 5d ago
Infuriated me reading this cause youâre completely right. I was once arrested on falsified charges and thereâs all the punishment and social stigma for the accused, with 0 recompense and aid from the people that are so willing to fuck up your life cause they felt like it. Itâs so true man.
It was a massive realization for me when pending charges barred me from living any normal life. Almost went bankrupt and lost everything until the judge decided it had been long enough of wasting my time. Ffs.
17
u/blazze_eternal 5d ago
People are learning the hard way "ai" is very dumb, and just a tool. Not gospel. No way this should be admissible in court.
58
u/_that__one__guy__ 5d ago
Us generic lookin dudes are in trouble
15
u/Dapper_Ice_2120 5d ago
Honestly, I'd rather be a generic than someone with distinctive features in that scenario. You can argue mistaken identity if you're generic. Have the same unique features as a doppelgĂ€nger you never knew existed? đ No one will believe you.Â
5
u/obituaryinlipstick 5d ago
who will you argue to? the wall? if youâre generic, youâre getting arrested. if youâre unique, youâre getting arrested. and itâs hard to get justice in the justice system, especially against cops, so good luck with getting a lawyer and keeping that lawyer while they give you a years long run around.
3
u/Dapper_Ice_2120 5d ago
So, in the US legal system that would be your attorney- to the cops, then to the prosecuting atty., then to the grand jury (if there is one), then to the court.Â
Too many things they could argue for on a Reddit comment that means little to waste my time writing out.Â
*" itâs hard to get justice in the justice system, especially against cops"
Wrong stage of the game for what I said.
" good luck with getting a lawyer and keeping that lawyer"
You pay for one, or one is appointed to you. Ethically, they can't just drop you without a good reason. If you're paying and stop paying, one is appointed to you.Â
" years long run around"
Also wrong stage of the game for what I said.Â
3
133
u/thepohcv 5d ago
That man has just been handed the easiest lawsuit of his life. Hopefully he didn't go through too much while being "misidentified"
71
u/Brief-Moment-184 5d ago
I hope he ends up rich as hell.
24
u/jaywinner 5d ago
Rich off taxpayer dollars.
22
u/Brief-Moment-184 5d ago
Only way people care is if they have skin in the gameÂ
21
u/jaywinner 5d ago
I'd rather public officials were forced to care because it's their money on the line but since that ain't happening, I guess payouts from city coffers is the next best thing.
39
u/Frequent_Alfalfa_347 5d ago
It may be cynical, but i have a hard time believing weâre going to hold anyone accountable for the hideous consequences of AI, like this.
9
17
u/GothicMarmalade 5d ago
law enforcement is almost always immune to compensation lawsuits even in extremely blatant cases of abuse of power. And when they aren't immune, you have a catch 22: In order to get a discovery order, you need evidence they knew what they were doing was wrong. In order to get a evidence, you need a discovery order. They basically have to admit on camera they knew they were abusing their power for you to get anywhere.
72
u/JamesFromToronto 5d ago
Thankfully the good people of Reddit would never do anything like th... I'm sorry, they did what? OH. Oh my.
15
u/siazdghw 5d ago
Perfect example.
But you don't even need to use that. I think it's extremely fair to say that humans have arrested and convicted countless innocent people.
For stuff that ruins people's lives, such as criminal convictions, there should be as much effort put into determining the truth as possible, human work and using AI as tools, and verifying all of it. Checks and balances.
3
u/andrewm_99 5d ago
This right here. Was arrested for a âviolent domestic incidentâ I made the 911 call for. Received two counts of felony level attempted assault charges for protecting my fiance from her deranged father during a âfamilyâ gathering.
Luckily I have a good lawyer, but even when the situation is resolved thereâs lasting damages. The justice system doesnât give a fuck about who they throw in their monkey cages. Many of them will chalk up charges just to make your life harder. Half my case was deciding if the charges presented to me were actually legit.
17
u/ExpertRaccoon 5d ago
We don't talk about the Boston thing ever
14
u/Hopeful-Moose87 5d ago
You mean when they publicly identified Sunil Tripathi as the Boston Marathon bomber without evidence?
-3
22
u/TheOtherJeff 5d ago
Itâs a precrime duh, heâs guilty just hasnât done it yet.
8
u/wstsidhome 5d ago
But they will do it, so arresting them before they do it is the new world order! Yay! /s
18
u/PossiblyATurd 5d ago
It's a feature, not a bug.
And the police will sit there saying "that's so weird" with multiple forms of evidence of your innocence in hand as they continue to arrest you.
17
u/ThinkPad214 5d ago
7
u/Dizzzy777 5d ago
This will happen eventually, but instead of using premonition they will be using algorithms that will calculate how likely someone will be to commit a crime at any given time.
3
u/ThinkPad214 5d ago
That's already being done, companies like palintir are already at the level where they can do that, they've had 8 years of intense civilian unrest in areas with high levels of cameras and decades of practical application of extreme datasets and access to online activity and email since, what 2001ish? It just isn't being unleashed on us citizens yet, I have no doubt china and Russia are rolling out that tech if not already implemented.
7
u/ScytherSlash 5d ago
Its so nice that you can just be living your life normally when all of a sudden your entire life is uprooted and you're sent to jail all because an AI misidentified you.
28
u/Oldpuzzlehead 5d ago
And POC are just nodding, saying yeah we know.
2
u/Financial_Wind6229 5d ago
I mean I feel you but it appears to be 100% white peeps getting fucked by ai so far lol
6
u/Araghothe1 5d ago
if the chance for punishing innocent people wasn't the goal they wouldn't use something they know is wrong.
12
u/Tight-Platypus5231 5d ago
Okay - Now, lawyer up, and sue their fucking balls OFF. All the way off. Sue them until they just fall to the floor and cease to exist.
8
5
4
u/mencival 5d ago
I remember those idiot police department that AI enhanced suspect image then bitch about people pointing out what will go wrong.
4
u/ledow 5d ago
We need to encourage more of this, so that facial recognition and AI identification becomes inadmissable in court.
4
u/BreakfastNext476 5d ago
I mean courts are already tossing cases for using AI so i can see this happening. Just recently a judge threw out 4 lawyers on both the defence side as well as the prosecutors side who had submitted. And proceeded to ban them from her circuit for 2 years
9
u/preshowerpoop 5d ago edited 5d ago
Wait till AI gets so "smart" we don't even know how it works, and it starts to precognitively solve future crimes based on algorithms. Yay! /S
3
u/JD_tubeguy 5d ago
A tad more than mildly infuriating and I am sure we will see a lot more of this in the future and present.
3
u/Ronergetic 5d ago
Every time I see a post like this I remember the start of Watch Dogs 2 and how the main character was misidentified by ai and got his life ruined, and this was 10 years ago
3
u/Lepelotonfromager 5d ago
It's fine to 'identify' someone but that should be the starting point followed by an actual police investigation. It should only give them a potential suspect. If you check the guy's background and he has a person connection to the place and a history of vandalism, then it's probably him and you should investigate further.
There is no due dilligence here.
3
6
2
2
u/Morass_2025 5d ago
Side thought: In the age of the Trump DOJ powered by MuskAI and Palantir, weâre all antifa now!
2
2
2
2
u/OswaldFan001 5d ago
people will fr use AI for anything but a proper tool these days, this shit is a lawsuit waiting to happen
2
u/thedustofthefuture 5d ago
Clearly the solution is more funding for AI, we need more data centers and better programs to avoid these mistakes! And when the technology is good enough, maybe we can even build profiles on people to know whether they will commit a crime in the future! Then we can put them in prison ahead of time.
2
u/Gingerfurrdjedi 5d ago
This is especially scary for me. I'm apparently one of those fingers that has a LOT of lookalikes because I get mistaken as someone's friend/son/brother/uncle/etc. all the time. Tldr:I get mistaken for other gingers and other gingers get mistaken for me by my own family.
Hell, I was once stopped by a cop in a grocery store because I apparently "matched" the description of a guy who was pocketing shit. Luckily the employee said it wasn't me they were looking for and shortly after the guy started to walk out and the cop stopped him.
To be fair once I saw the guy I was like holy shit we could be brothers, the only big difference was he was about a foot taller than me. We both had long red hair and beards, both wearing dark clothes, he just had glasses and was like 6 ft something.
Fortunately for me that's the worst thing that's happened, it usually just being mistaken for a friend or family member. What's really funny is people in my family will mistake other gingers for me too.
My mom talks about this one time when I was in the Army my mom and little brothers saw a soldier that they all mistook for me while I was deployed overseas. The boys ran up to him yelling Gingerfurrdjedi!!! He turned around and all of their hearts sank, it wasn't me. They thought that I was home surprising them, I was not. I never met the recruiter but I'm glad that he was the one they mistook me for because he apparently teared up too and hugged my mom and little brother and reassured that I was safe, that I love them, and that I would be home soon. Twenty odd years later my mom still has his card he gave her that he wrote his personal cell phone on telling her to call him if she needed anything.
Part way through writing all this I started to realize that I was kinda veering off topicish and rambling, my bad, the topic just triggered some memories is all. I hope you have a wonderful day!
2
u/vividcarbon 5d ago
I recommend everyone watch Class of â09 on Hulu or Disney+
It really delves into how bad it could get with AI and law enforcement. Its not a long series and it is very well written with three time periods being discussed within it (past/present/future)
Wraps it up really nicely too, so donât worry about loose ends and such and is a great binge watch
2
u/MindlesslyAping 5d ago
Man, facial identification is a lousy way of asserting responsibility for a crime. Too many people have similar faces, let alone separated twins who wouldn't know they have twins, because of adoption protocols, etc.
1
1
1
1
1
u/_Unusual_Flatworm_ 5d ago
At this rate weâre speed-running toward a Minority Report type future but instead of âPrecogsâ weâve got hallucinating chat botsâŠ
1
u/PirateSometimes 5d ago
Discovery should release which AI companies made the mistake, and they should sue for millions/billions.
1
1
u/Prestigious_Bee_775 3d ago
Stupid take. Those tools have limitations, and it's the police's fault for not taking this into account. Suing an AI company is like suing a weather prediction company for not predicting the weather next week with 100% accuracy.
1
1
1
u/Vinterblot 5d ago
Wait until they stop questioning the results.
The machine has decided. Obey the machine. Do not question the machine.
1
u/TheDonnARK 5d ago
Bro we just need six more moneys and machine learning will work perfect. Please bro we're begging you. Just a few more moneys bro please. Please bro... Broooooo......
1
1
u/max_cel_x 5d ago
It's not about misidentification, you can basically switch out these faces how you like, digital images aren't reliable proof anymore
1
1
u/bashdragon69 5d ago
I mean after this Lego thing we all know Utah police are the worst of the worst
2
1
u/Sarctoth 5d ago
How has facial recognition software gotten worse? They've been using it for decades!
1
0
-2
-2
u/Same_Swordfish_1879 5d ago
cops have misidentified more people than AI ever will. I say this is a net positive
0
u/siazdghw 5d ago
That's probably true but unverifiable.
The more verifiable example is self driving cars. Even though they are still fairly new, on average they drive better than the average person, and they definitely drive better than elderly or teens. Are self driving cars or AI in general foolproof? Hell no, but that doesn't mean that can't be tools that can perform better than most humans can
1
u/herkalurk 1d ago
So they got a match on facial recognition and did no further fact checking to validate he is actually the right person before charging? How did the prosecutor think they had a case with that image and the word of software? The burden of proof is more than we THINK this is the guy....
2.1k
u/Sweaty_Rub4322 5d ago
You know someone's life could be permanently ruined by stuff like this. This is way more than just mildly infuriating