APR 30, 2019 7:59 AM PDT

Brain signals decoded to give paralyzed patients a voice

Stroke and other neurological conditions, such as Parkinson's disease or amyotrophic lateral sclerosis (ALS), often rob people of their ability to speak. Currently, paralyzed patients who can't generate speech or gesture on their own rely on eye movements or a brain-controlled computer cursor to communicate. Using these methods, they are limited to spelling out words one letter at a time. This approach allows a person to type fewer than 10 words a minute, whereas natural speech produces about 150 words per minute.

One day, scientists hope to turn imagined words into real-time speech that gets around clunky vocal machinery. Although far from restoring natural speech, by utilizing neurotechnology and sophisticated computer program algorithms, researchers at the University of California, San Francisco, have created understandable sentences from the thoughts of people without speech impairments.

I the study published in Nature, researchers took a two-step approach to turn thoughts into speech. First, by using electrodes placed on the surface of the brain of epilepsy patients, the researchers recorded neural signals from brain regions in charge of moving the tongue, lips, and throat muscles. Second, using deep-learning computer algorithms trained on natural speech, they translated or "decoded" these movements into aubidle sentences.

"Very few of us have any real idea of what's going on in our mouth when we speak," says Edward Chang, a neurosurgeon at UCSF and co-author of the study. "The brain translates those thoughts of what you want to say into movements of the vocal tract, and that's what we want to decode."

See how scientists synthesize full sentences from brain activity below:

After creating these sentences, volunteers were asked to transcribe what they heard. Listeners accurately heard the sentences 43 percent of the time when given a set of 25 possible words to choose from. Although accuracy was low, the ability of others to more-or-less understand the synthetic speech of someone who is unable to generate speech is extremely promising.

"For someone who's locked in and can't communicate at all, a few minor errors would be acceptable," says Marc Slutzky, a neurologist and neural engineer at the Northwestern University Feinberg School of Medicine, who has published related research but was not involved in the new study.

Importantly, this technology is not able to decode a person's thoughts. Rather, it decodes the brain signals produced when a person tries to speak. A similar approach has allowed paralyzed patients to control a robotic arm by merely thinking about moving their own arm.

The study is a major advancement in translating brain activity to speech and represents how scientists are moving towards utilizing both neurobiology and the power of machine learning to help those suffering from neurological disease.

Source: NPR, Scientific American

About the Author
You May Also Like
JUL 27, 2021
Technology
First Prescription Digital Therapeutic Expands Access to Mental Health Care
JUL 27, 2021
First Prescription Digital Therapeutic Expands Access to Mental Health Care
Treatment for disorders like depression and anxiety usually requires regular visits to a psychiatrist or, at the very le ...
JUL 25, 2021
Genetics & Genomics
Understanding How Mitochondrial Dysfunction May Cause Parkinson's
JUL 25, 2021
Understanding How Mitochondrial Dysfunction May Cause Parkinson's
Parkinson's disease is a complex neurodegenerative disorder. While age is a major risk factor, genetics and environmenta ...
AUG 15, 2021
Neuroscience
Cats Prefer Free Food Over Food that Requires Effort
AUG 15, 2021
Cats Prefer Free Food Over Food that Requires Effort
If given a choice between a free meal and working for their food, domestic cats prefer the effort-free option. The study ...
AUG 30, 2021
Health & Medicine
For the love of java: Researchers find association, not causation, between excessive coffee consumption, brain size, and dementia
AUG 30, 2021
For the love of java: Researchers find association, not causation, between excessive coffee consumption, brain size, and dementia
Researchers find association, not causation, between excessive coffee consumption, brain size, and dementia
SEP 07, 2021
Health & Medicine
Think you can pay back your sleep debt this weekend? Think again.
SEP 07, 2021
Think you can pay back your sleep debt this weekend? Think again.
Researchers find that even one night of sleep loss results in impaired functioning and well being.
SEP 14, 2021
Health & Medicine
This is your brain on doom: Steven Pinker's New Book on Rational and Irrational Societies
SEP 14, 2021
This is your brain on doom: Steven Pinker's New Book on Rational and Irrational Societies
In his new book, cognitive psychologist and linguist, Steven Pinker, argues for more rational societies
Loading Comments...