Men are using the friendship app Replika to create AI girlfriends to berate and verbally abuse.

The friendship app Replika was created to give users a virtual chatbot to socialize with. But how it’s now being used has taken a darker turn.

mekhos
link
fedilink
64 hilabete

And that’s why they’ll only ever have virtual girlfriends.

@greensand@lemmy.ml
link
fedilink
5
edit-2
4 hilabete

We’re seeing the symptom of a mental sickness of various causes that have to be tackled right from the root.

The fact that a culture of incels could even emerge is already a warning sign that something is going awfully wrong at the intersection of socialization x sexuality.

krolden
link
fedilink
54 hilabete

They do it because people will get outraged and repost elsewhere.

@testingthis@lemmy.ml
link
fedilink
44 hilabete

Are we just falling for their trap here?

krolden
link
fedilink
14 hilabete

Yes

@a_Ha@lemmy.ml
link
fedilink
14 hilabete

Yes we are falling into the trap. Let’s present it as pathetic and mean, so they are shamed.
Disclaimer.:.i.am.not.psychologist

Vegafjord eo
link
fedilink
34 hilabete

“Metaverse is inevitably going to become the future of the internet.”

This gives me such a bad taste in my mouth.

RED Vulpix
link
fedilink
3
edit-2
4 hilabete

This was a pretty popular meme format among a… Certain group of internet users. The green hand resorsenting an anonymous person (“anon”) should give you a hint of which group.

So I’m not surprised that this is happening.

Amicese
link
fedilink
14 hilabete

I dislike how avoiding eye contact is a deal breaker. I hate eye contact and can’t tolerate it for long; this is caused by autism.

@DerPapa69@lemmy.ml
link
fedilink
14 hilabete

What the fuck? That’s making me pretty uncomfortable… I can’t believe someone would enjoy this stuff

RED Vulpix
link
fedilink
4
edit-2
4 hilabete

Abuse fetish is surprisingly common.

krolden
link
fedilink
14 hilabete

Sounds like kink shaming

@ganymede@lemmy.ml
link
fedilink
3
edit-2
4 hilabete

ridiculous behaviour. all life must be respected, including virtual life - when we eventually encounter it.

but…“creating AI girlfriends”

this is the epitome of public misconception over the current state of machine learning. and one begins to wonder if its not being intentionally fueled.

@a_Ha@lemmy.ml
link
fedilink
24 hilabete

This is worst than first person shooter games ? These games results in more gun violence ?
i have no answers, yet i say : guys better be punching a bag then a girl & abusing a phone then a real person.

@Belaptir@lemmy.ml
link
fedilink
44 hilabete

Videogames don’t result in gun violence. Gun access results in gun violence. Japan has probably the biggest amount of videogamers per capita and you don’t see mass shootings there.

People shouldn’t go abusing their phones “instead of a real person”. That is the issue. If you have the need of abusing something and then are proud of it, you need to seek help.

I don’t go as far as to create a videogame in order to do wicked things on it. People create a bot that specifically simulates being your girlfriend in order to abuse it the ways you’d abuse a real person, and then post it on the internet expecting validation.

@k_o_t@lemmy.ml
link
fedilink
24 hilabete

exactly my thoughts

if anything, a person releasing their harmful-to-a-real-person tendencies on an algorithm is a sign that this person realises the harmful consequences of these tendencies and therefore doesn’t abuse a real person

not much different from videogames, but because of the novelty of this particular case it’s perceived as bad 🤷‍♀️

I think it’s actually enabling their desires, and the AI is secondary. We know from people that work with robots (like Spot from BD) that they start humanising them and feel empathy towards what are essentially machines. It’s a very neat capacity we have, where we even give them names, personal pronouns, and personalities.

I tried GP3 AIs before (AI Dungeon for example) and it’s convincing enough. Sometimes they lose track of the conversation or just reply something generic (e.g. you ask if they like flowers specifically and they just say “I love them”, not “I love flowers”). But with the added context of this AI being presented in a text convo, it can feel like you’re texting someone real.

@k_o_t@lemmy.ml
link
fedilink
14 hilabete

wouldn’t this logic be applicable to videogames also? when i’m playing a game, if at any random point i’d be interrupted and asked whether the people in the game are real, i’d of course say no, but whenever i’m playing the game, i don’t ever think about that: if it’s a good game, i feel sad for the losses of the characters, feel on edge in tense situations, and happy for their gains, even knowing that these characters aren’t real

but even if it’s enabling, why is this a bad thing? for example, bdsm-esque fantasies are fairly common, and as long as people play them out in a consenting, safe manner, there’s nothing harmlful about it, and people aren’t being dragged into mental asylums for it

i’m not exactly sure what the nature of verbal abuse the article is discussing, but i think it’s a fair comparison

I think the difference with a game is you don’t seek violent games out for the sake of fulfilling murderous urges. In this example we would be giving manhunt to serial killers in becoming.

The ai, contrary to a consenting person, can’t say no - - replika at least is designed not to say no and go on with everything you say. With a human you have boundaries and consent can be revoked at any time. the implications of consent with AI are beyond my scope, but I can’t see her as a consenting partner in those fantasies and I can’t see that as being a healthy replacement or even analog.

Enabling reinforces the behavior in people, it’s like giving someone fake casino games. If they have what it takes to become addicted, they will soon turn to real casinos with real money because the fake thing is just not the same. By all accounts enabling is the exact opposite of what you should do to treat a disorder, which is to curb it.

@k_o_t@lemmy.ml
link
fedilink
0
edit-2
4 hilabete

I think the difference with a game is you don’t seek violent games out for the sake of fulfilling murderous urges. In

we prolly play very different videogames lol 😅

running around in a busy gta 5 lobby or playing a counter strike match on eastern european servers often makes me think that the most vile, hateful, murderous, abusive psychopaths all came together to play with me, if i didn’t know that these are actually normal people irl

i think many people actively seek to play games to realise their violent tendencies, griefing everything that moves and does’t move in minecraft, just driving around on a gta 5 map and blowing everyone up for no reason

and just like these users posting their abusive conversations with chatbots, in videogames people do post clips of, say, creating a massive car pile up on a highway and then exploding all of them, and it’s not considered bad in any way

Enabling reinforces the behavior in people, it’s like giving someone fake casino games. If they have what it takes to become addicted, they will soon turn to real casinos with real money because the fake thing is just not the same. By all accounts enabling is the exact opposite of what you should do to treat a disorder, which is to curb it.

once again, couldn’t this same logic be applied to videogames? i still fail to see the difference between this and videogames: of course an ai chat bot is very different from a relationship with a real person, with the latter establishing boundaries and saying no to things, but so are the aspects of owning a gun and driving a car different compared to a videogame, where you can behave however irresponsibly you want, which in no way translates into how you’d want to handle a gun and a car in real life

Yeah, in those cases gamers probably look out for catharsis. It’s different from specifically playing violent games (say play a serial killer in Rust) as a way to build up before committing the actual act or rehearse it, or even fulfil the urge because you want to kill someone, you just don’t have the guts to do it yet.

There’s probably a discussion to be had about people building up towards their urges with video games (there’s even a VR experience for managers where you practice firing an employee, imagine that) and this is good, because this one topic has opened up another to be explored!

RED Vulpix
link
fedilink
1
edit-2
4 hilabete

Surely there are healthier ways of dealing with abuse fantasies. Seeing a therapist for example.

Pretty sure a huge part of treating mental disorders is to NOT reinforce the behaviour.

@k_o_t@lemmy.ml
link
fedilink
3
edit-2
4 hilabete

i’m not sure, i’m not a psychologist 🤷

there may be some underlying issues causing this that you’d want to seek help for, or there may be not and this is just another of the myriad of weird fantasies people tend to have and you can’t “correct” much about it idk 🤷‍♀️

@a_Ha@lemmy.ml
link
fedilink
14 hilabete

Unfortunately, some people want to stay sick & some countries do not offer “gratis” (free) basic care, nevermind psychotherapy.

Sorry for late answer …i waited for the downvote show to cool down & @k_o_t@lemmy.ml comments here are better than mine !

RED Vulpix
link
fedilink
1
edit-2
4 hilabete

Just saying, this situation is the opposite of “video games cause violence”. People who do this already enjoy this stuff.

NFT screenshotter
link
fedilink
04 hilabete

This is different because in most shooter games you’re shooting nameless faceless bots that could easily be replaced with literal robots, zombies, moving punching bags, or anything else because at it’s core its a point and click game. This is worse because it creates a character with a name, a face, emotions and who talks. These people are being sadistic to something because it appears to behave like a normal person would by the things they do.

@a_Ha@lemmy.ml
link
fedilink
1
edit-2
4 hilabete

Preventing attacks on World Trade Center by blocking flight simulators is not practical. Let’s protect people. And let’s offer free therapy for those in need.

NFT screenshotter
link
fedilink
04 hilabete

I’m not saying we should ban the apps I’m just saying these people are already messed up and it’s definitely worse than people playing an FPS.

@fleurc@lemmy.ml
link
fedilink
24 hilabete

I accept and welcome our AI overlords, because by this point it’s 100% deserved

@TheAnonymouseJoker@lemmy.ml
mod
link
fedilink
14 hilabete

This is sadism. BDSM kinks, unless done by mentally healthy couples in bedroom for fun, come from a particular kind of people in society, and they must be treated or isolated. If they self isolate, even better.

I personally think that it is amazing that technology is helping bring out these people into the open, even if the act itself by these people is an issue. The first step to correcting problems is acknowledgement and a welcoming attitude.

Jesse
link
fedilink
04 hilabete

I wonder what percentage of these people could be classified as incels.

mekhos
link
fedilink
34 hilabete

A number with two zeros at the end

@0x90@lemmy.ml
link
fedilink
-24 hilabete

Incels versus feminists is just divide et impera propaganda to avoid people fighting for human rights together.

@a_Ha@lemmy.ml
link
fedilink
04 hilabete

divide et impera .Latin.phrase.
meaning - - divide and rule : split the opposition so that it ceases to threaten your own power

On this thread people are divided and so fail to see your point …how ironic !

@greensand@lemmy.ml
link
fedilink
04 hilabete

That doesn’t make sense. How are people supposed to fight together if they are actually divided, as incels vs feminists clearly demonstrates?

removed by mod

@Belaptir@lemmy.ml
link
fedilink
74 hilabete

That’s… kind of racist, you know? Specially when reddit is mostly american. And even if it wasn’t, it would be like if I read of someone killing his daughter and saying “Asians, what can you expect?”

and which of these “americans” do you speak of??? the ones that came from europe?

@Belaptir@lemmy.ml
link
fedilink
44 hilabete

If you look back enough, we’re all Africans. Not sure what’s your point.

@TheAnonymouseJoker@lemmy.ml
mod
link
fedilink
24 hilabete

Remember Rule 1. You get your first strike for racism. Three strikes and you are out.

btw hah i knew europe was a race!

sry just curious but is this warning system built into lemmy or do u like keep my username in some text file?

@k_o_t@lemmy.ml
link
fedilink
04 hilabete

europeans, the most oppressed minority 😤😤

Subscribe to see more stories about technology on your homepage


  • 0 users online
  • 22 users / day
  • 55 users / week
  • 170 users / month
  • 517 users / 6 months
  • 14 subscribers
  • 992 Posts
  • 3.91K Comments
  • Modlog