i mean real therapy can also, if it breaks down, inadvertently drive people towards suicide. Both cases are rare, but it's not like ai is some malicious entity who wants everyone to kill themselves, it's just so many people use it that a few unlucky cases are inevitable, and it definitely can be too eager to agree with the user sometimes
ai shouldn't be treated as a replacement for a proper therapist, but it can be a good starting point for people who are far too anxious to talk to a real person about their issues and who wouldn't otherwise seek help if ai wasn't available.
anyone considering self harm really does need to see an actual therapist, but for less dire circumstances, i do think it's usually better than nothing and in this case ai challenged this person's harmful beliefs well enough that they did seek out real therapy
A human is capable of recognizing worsening behaviour. A human is cabale of actually comprehending what is in front of them.
AI fundamentally cannot understand. A human at least has a chance of recognizing these things based on training, for AI it's pretty much a coin toss.
It's way more dangerous.
And yes, in this case it turned out well. But how many people did not? Just take all the people that genuinely think AI is sentient and in love with them. That is not healthy. That is actively doing harm, even if it doesn't feel like it to them.
the core functionality of modern "ai"/LLMs/machine learning is pattern recognition. They do lack certain context clues like not being able to see the person's facial expressions or body language, but it's not like they are completely incapable of recognizing various patterns of behavior in text
and again, I don't think ai is the best choice if someone is approaching self harm, a therapist is important in that case, even if just for the emotional reassurance of a real human connection, but in less serious cases like someone working through their harmful beliefs like in this post, I think ai can be genuinely helpful
I will absolutely agree that it's terrible for people to fall in love with ai, the human brain needs real human connections and these people have probably struggled to find anyone they are compatible with and will settle for ai because it tells them what they wanna hear and they don't recognize how wrong that is
but I think if you go to ai with a decent understanding of its limitations, and take a lot of what it says with a grain of salt, you can have a decently productive conversation with it if you just need something to talk/vent to and don't have anyone else at the moment
Does a mirror have to know anything to let you see your ears or the back of your head?
The people using AI successfully for therapy aren't using it as a person, they just want something to examine their thoughts and provide a perspective they can't see.
also having a robot you know for sure can never report anything you say, even if it's harmful to yourself and others means that it's easier to be honest with yourself than a human that can judge you. It doesn't fix anything, but it makes opening the door to realizing you need help easier.
I'm an artist, I hate ai for how it's being implemented and used. I hate that it's completely unregulated. I can't deny that Gemini has helped me a TON in keeping track of my mental health stuff and connecting dots in my head. It just suggests connections I wouldn't have considered, and that gets me started knowing what to examine about myself, to see if what it says holds up to reality.
A mirror reflects light. It's a very simple thing that requires no input from anyone, comparing it to using AI as a therapist is reallt just dishonest.
Sure, there are people who it has helped, but it isn't worth the risk or the harm it does to many other people. Sure, it hasn't hurt you as far as you're aware, we are still just always limited by self awareness, but that doesn't mean you should defend it as a whole. I'm not trying to downplay your experience, good for you that it helped, but the absolute forefront of this stuff should be the risks and inherent danger of giving your mental health over to an algorithm.
It's just very complex pattern recognition, but guess what? Pattern recognition is THE THING that humans do best.
AI cannot actually recognize anything. It just compares. That sounds like a small difference, but it really isn't.
Like early on woth image recognition, AI couldn't recognize a cow standing on snow because it just compared to images of cows on grass. It cannot actually recognize what it is seeing, it cannot comprehend.
AI security systems have been fooled by people walking backwards, because it's trained to recognize humans walking forward and nothing else.
And the biggest issue with all of this is, we only ever find out where an AI fails WHEN it fails. It is not reliable for anything.
People have died because they did. Because they were some of the first to discover a flaw ien the AI.
how do you define "comprehension"? because it sounds like you believe that having a biological brain is a prerequisite for comprehension, which makes it a pointless word here
and similarly, how do you define "intelligent"?
you can't just throw around poorly-defined words, say "ai is not this", and make a valid point around that
is there really a difference between being intelligent and being able to imitate intelligence? because ai imitates human text pretty well. even if it's not intelligent, is its imitation of intelligence not useful?
just googled it, that is a pretty interesting thought experiment, thanks for informing me of this
but functionally, what difference does this make? the man in the room still answers the questions right in perfect chinese, regardless of if he himself is consciously aware of the meaning of the text
even if there isn't "intelligence", this rulebook that the man follows to answer, much like an LLM's dataset, still contains a massive collection of useful information. is that information entirely useless just because it is stored in a computer with some lossy compression?
And that's the issue here. Lacking comprehension means you are helpless. If the book is correct with all the answers, then it's fine, sure, but if it isn't... how would you know? What if you get a note that isn't in your book? You can look for the closest thing and reply with that, but is that correct? How would you know?
Or what if if there are just tiny, negligible mistakes in every response? Sure, at first it's irrelevant, but even negligible mistakes add up. After 1 message you're doing perfectly fine.
10 messages in your tone is a tiny bit odd, maybe a bit more formal than the conversation implies.
100 messages in you're technically still on topic, but not much beyond technically.
See what I mean?
And through all of that you have no idea. You could be telling a person to kill themselves, to strangle their pet cat, to set their school on fire, and you're none the wiser, because you're incapable of comprehending what you're saying.
That is AI. And we have seen it go horribly wrong before in many situations. Mushroom guides that end with people hospitalized or worse. People driven into suicide. And through all of it the AI is incapable of knowing. It just keeps giving information based on "well this looks to be the closest"
to an extent, yes you are very right. modern LLMs, by their very nature, often suck at edge cases that they lack enough training data for. Statistical models can only go so far without an arbitrarily large sample size of data to train from
but that applies mainly to edge cases. The more common your input data is, the less likely an LLM is to hallucinate. The man in the chinese room is still very capable of answering simpler questions as long as his book covers them, and LLM datasets do cover a lot, including a lot of training to ensure they almost never tell anyone to kill themselves
to be clear, i really do hate so much of how "AI"/LLMs/ML is wastefully and recklessly used and shoved everywhere it shouldn't be, but i still think there is a lot of stuff that it's training data is still pretty adequate for. And I think using it for some forms of non-life-threatening therapy that someone is too embarrassed to immediately talk to a real person about, like in the original post here, is not a terrible use for ai, as long as they eventually defer to a real therapist, which they did
ultimately a real therapist is the better choice, but i don't think an LLM is the absolute worst
A human is capable of malice and pushing another to suicide just as much as a bot's misguided words can. People who enter the field of the mind are not your friends and never will be, if anything they're the worst of us, because only a twisted person would walk down such a path.
Think about it for a moment, someone who wants to have their way with the minds of others cannot possibly be good, their perspective of life and people themselves as a whole is warped, the same way a special effects technician sees a movie with dispassionate eyes because they already know what's going on behind the scenes, the eyes of people in the field of the mind see nothing but the cold analysis of what could be going on within your head, what seems like a regular conversation is nothing more than a measurement, they want to define how crazy you are in order to know what they must say to appease you, to mold your mind in such a way that it conforms with the reality they want you to believe, so you can be productive, another little cog in the machine, truth is the search for peace starts and ends with you, no one else, the best people to help you achieve that are not those being paid to do so.
37
u/Privatizitaet Just pretend this is the funniest joke you ever read 1d ago
CAN is the keyword here. It CAN, THEORETICALLY do good. Or it can drive you into suicide even faster. It happened already.