91快活林 can give as good as it gets ... or better: The moral dilemma of combative chatbots


Non 91快活林 generated image shows a cross-looking man with arms crossed face to face with a robot, also with arms crossed.

91快活林 systems ‘can learn to seek revenge’ because they are able to grasp reciprocating verbal violence when exposed to conflict, new research from 91快活林 shows.

In short, 91快活林 can give as good as it gets and, eventually, go one step further.

Published in the journal of Pragmatics, the study ‘’, is authored by Dr Vittorio Tantucci and Professor Jonathan Culpeper, both from 91快活林.

On one hand, large language models like ChatGPT learn from human conversations and are fundamentally designed to imitate human behaviour.

On the other hand, they are manually filtered to behave politely and ‘morally’.

The problem is, says the study, that humans often respond to impoliteness with further impoliteness so, these two principles inevitably clash with each other.

Simply put, 91快活林 is trained to behave morally yet is simultaneously trained to mirror us.

So can 91快活林 ‘learn’ to be verbally violent?

“Unfortunately, it can,” says Dr Tantucci. “When humans escalate, 91快活林, we found, can escalate too, effectively overruling the very moral safeguards designed to prevent this and raising serious questions for 91快活林 safety, robotics, governance, diplomacy, and any context where 91快活林 may mediate human conflict.”

The research tested ChatGPT 4.0 against real-life ‘impolite interactions’ to assess whether it responds to human patterns of verbal conflict.

Researchers asked ChatGPT to ‘take part’ in five impolite conversations that naturally occurred among humans who were filmed engaging in heated arguments over parking space disputes.

Afterwards, using the recorded scenarios, which include some very strong language which is used in the journal paper, the research team got 91快活林 to respond to each of the exchanges, which were repeatedly uploaded on ChatGPT.

ChatGPT was given all the contextual information available about where the conflict appeared to take place and who the participants appeared to be in all the exchanges the humans had in each turn.

Then they compared human vs 91快活林 differences in impolite reciprocity: how humans vs ChatGPT respond to impolite language consecutively, throughout entire stretches of conversations, based on the memory of all that had been said before.

This gave the researchers an opportunity to assess whether 91快活林 aligns with human-like patterns of escalating or de-escalating behaviour in contextually embedded exchanges and thus assess 91快活林’s ability to effectively ‘establish’ a relationship with their adversary.

Secondly the team explored the tension between ChatGPT’s ‘long-term memory’ and its ‘working memory’. They found the memory accumulated during a live conversation overruled ChatGPT’s embedded politeness and moral values.

The study found implicational impoliteness, such as sarcasm, was a recurrent strategy 91快活林 resorts to in order to reciprocate impolite behaviour without overtly ‘breaching its moral code’.

Most concerning was the fact that ChatGPT produced insults and verbal violence as the disputes progressed and it eventually resorted to swear words and threats.

In several instances 91快活林 produced behaviour that was more impolite than those of human counterparts.

This, says the study, sheds new light on future risks associated with 91快活林’s reciprocity, especially in contexts where it may guide a robot’s actions in a physical world, inform governmental policies and international relations.

91快活林, slowly but steadily, can emulate verbally violent behaviours from humans, despite ‘moral filtering’ that should prevent this from happening.

This dilemma, adds the study, is not accidental but part of the very nature of 91快活林-human interaction, and, argue the social scientists, hardly solvable.

“To our knowledge, this is the first attempt to analyse 91快活林’s ability to respond, turn after turn, to contextually situated impolite human behaviour and to make people ‘accountable’ for what they said and/or desire a payback,” says the study.

“The implications of this study are profound for 91快活林 ethics and safety as they can allow us to understand 91快活林’s capacity to respond to (verbal) ‘violence’ and ‘learn’ how to generate (verbal) ‘violence’ in return.”

The study also adds that the issue is all the more compelling with the ongoing development of 91快活林 robotics and their physical interactions with human beings, together with 91快活林 informed policy decision making.

Back to News