Impact of Advanced AI Systems on Trust in Communication
As artificial intelligence (AI) becomes more advanced and realistic, it may compromise our trust in those with whom we communicate. Researchers at the University of Gothenburg have examined how advanced AI systems impact our trust in the individuals we interact with.
Exploring the Problem of Trust and Conversational Agents
In one scenario, a would-be scammer, believing he is calling an elderly man, is instead connected to a computer system that communicates through pre-recorded loops. The scammer spends considerable time attempting the fraud, patiently listening to the “man’s” somewhat confusing and repetitive stories. Oskar Lindwall, a professor of communication at the University of Gothenburg, observes that it often takes a long time for people to realize they are interacting with a technical system.
In collaboration with Professor of informatics Jonas Ivarsson, he has written an article titled Suspicious Minds: The Problem of Trust and Conversational Agents, exploring how individuals interpret and relate to situations where one of the parties might be an AI agent. The article highlights the negative consequences of harboring suspicion toward others, such as the damage it can cause to relationships.
The Negative Consequences of Suspicion
Ivarsson provides an example of a romantic relationship where trust issues arise, leading to jealousy and an increased tendency to search for evidence of deception. The authors argue that being unable to fully trust a conversational partner’s intentions and identity may result in excessive suspicion even when there is no reason for it.
Their study discovered that during interactions between two humans, some behaviors were interpreted as signs that one of them was actually a robot.
The Problem with Human-like AI Features
The researchers suggest that a pervasive design perspective is driving the development of AI with increasingly human-like features. While this may be appealing in some contexts, it can also be problematic, particularly when it is unclear who you are communicating with. Ivarsson questions whether AI should have such human-like voices, as they create a sense of intimacy and lead people to form impressions based on the voice alone.
In the case of the would-be fraudster calling the “older man,” the scam is only exposed after a long time, which Lindwall and Ivarsson attribute to the believability of the human voice and the assumption that the confused behavior is due to age. Once an AI has a voice, we infer attributes such as gender, age, and socio-economic background, making it harder to identify that we are interacting with a computer.
The researchers propose creating AI with well-functioning and eloquent voices that are still clearly synthetic, increasing transparency.
The Impact on Communication and Relationships
Communication with others involves not only deception but also relationship-building and joint meaning-making. The uncertainty of whether one is talking to a human or a computer affects this aspect of communication. While it might not matter in some situations, such as cognitive-behavioral therapy, other forms of therapy that require more human connection may be negatively impacted.
Studying Conversational Agents on YouTube
Jonas Ivarsson and Oskar Lindwall analyzed data made available on YouTube. They studied three types of conversations and audience reactions and comments. In the first type, a robot calls a person to book a hair appointment, unbeknownst to the person on the other end. In the second type, a person calls another person for the same purpose. In the third type, telemarketers are transferred to a computer system with pre-recorded speech.
Source: University of Gothenburg. Content edited for readability.
AI NewsTime