NOV 11, 2021 6:46 AM PST

Chatty Chatbots Learn to Cope with Figurative Language

WRITTEN BY: Mia Wood

Chatbots. Increasingly ubiquitous and (for this writer, anyway) unfailingly annoying, these computer systems can make or break a user’s experience. Sadly, perhaps, FAQ pages aren’t enough, anymore. When we land on a website, we apparently need “interaction.” (Whatever that means, since a chatbot is just an algorithm designed to stand in for an actual human.)  Enter the chatbot or other dialog system.

Pre-populated with answers to standard questions, chatbots have a closed and narrow list of possible responses, which means the human user has to adjust. That adjustment, in turn restricts communication in ways that often feel unnatural. Indeed, the experience often feels as if the human must accommodate the chatbot, rather than the other way ‘round. You know you’re in trouble when you long for the days of interminable hold times followed by an unhelpful, but still human, customer service representative.

The general problem with the chatbot seems to be that it can’t think. Consider the Turing test. In his 1950 paper, mathematician Alan Turing proposed the Imitation Game as a test of computing intelligence. If a human believes they’re talking to another human during a text-based chat, then the machine has exhibited thought or intelligence. 

But let’s suppose the human types this joke: A vacuum cleaner salesman turns up on a person’s doorstep. “I’ve got a vacuum that sounds too good to be true,” he says, “but it’s real. This vacuum is so effective, it’ll cut your housework by half!” The person thinks for a moment and says. “One vacuum cuts my housework in half, you say?” The salesman nods vigorously. “Why, yes. Yes, it does!” After a moment’s more thought, the person says, “Okay, I’ll take two!”

An ordinary chatbot won’t get why it’s supposed to be funny — not unless it’s programmed to detect the ambiguity at the heart of the joke. Such detection would be no small feat indeed for a program limited to queries about things like product returns. Chatbots require an enormous amount of conversational data as training material, so expanding the program’s repertoire might be more trouble than it’s worth, particularly when things like jokes are obviously outside the scope of, for example, an ordinary customer service exchange. (Siri and Alexa have apparently learned to engage with the ha-ha’s, but we’re still left to wonder if they have a sense of humor — but that’s a topic for another article!)

 

 

Ordinary language is replete with ambiguities that elude dialog systems such as chatbots. In a recent study, “Investigating Robustness of Dialog Models to Popular Figurative Language Constructs,” computer scientists from Carnegie Mellon University and UC San Diego found that computer dialog systems, like virtual personal assistants and chatbots, aren’t proficient with figurative language. Such systems stumble over idioms like, “He got cold feet when it came time to parachute from the plane.” Confronted with conversations that emphasized this sort of language, dialog system performance suffered.

Lead authors, Harsh Jhamtani and Taylor Berg-Kirkpatrick set out to document when and how much dialog systems stumble — and to test a candidate for helping the system to improve. First, they found that dialog system performance dropped considerably when conversation data sets emphasized figurative language. After writing a script for systems to scan dictionaries for translations of figurative language into literal expressions, dialog system performance improved up to 15%. While there is more work to be done to preserve, for example, the meaning of a figurative expression, the hope is that improvements to dialog system scripts will improve human engagement.

Sources: Neuroscience NewsCornell University arXive

About the Author
PhD, Philosophy
I am a philosophy professor and writer with a broad range of research interests.
You May Also Like
MAR 11, 2022
Earth & The Environment
Estimated 9000 Undiscovered Tree Species Worldwide
MAR 11, 2022
Estimated 9000 Undiscovered Tree Species Worldwide
Humans have always been obsessed with cataloging and categorizing plants and animals. Plants, being stationary, have bee ...
MAR 21, 2022
Space & Astronomy
Jupiter - The Majestic Planet
MAR 21, 2022
Jupiter - The Majestic Planet
Jupiter, the fifth planet from the Sun – The Majestic Planet, with its massive size, swirling multi-colored clouds ...
APR 14, 2022
Earth & The Environment
Confirmation Bias or Captivating Discovery? Paleontology at the Tanis Site, North Dakota
APR 14, 2022
Confirmation Bias or Captivating Discovery? Paleontology at the Tanis Site, North Dakota
In 2020, when I was still working at a small natural history museum in Hot Springs, South Dakota, I started to hear whis ...
APR 19, 2022
Technology
New Tool for Detecting Counterfeit Pharmaceuticals
APR 19, 2022
New Tool for Detecting Counterfeit Pharmaceuticals
Counterfeit drugs have always been a problem; in fact, it’s estimated that nearly 10% of global pharmaceutical sal ...
MAY 06, 2022
Space & Astronomy
Two Largest Marsquakes Recorded to Date FTW!
MAY 06, 2022
Two Largest Marsquakes Recorded to Date FTW!
On November 26, 2018, NASA’s InSight Mars Lander touched down on the Red Planet with the purpose of studying the i ...
MAY 16, 2022
Chemistry & Physics
A Strange 'Black Widow' Pulsar Candidate in Our Galaxy
MAY 16, 2022
A Strange 'Black Widow' Pulsar Candidate in Our Galaxy
Pulsars are remnants of dead stars that die by the process of supernova explosion. These explosions often leave either a ...
Loading Comments...