JAN 31, 2019 12:57 PM PST

Translating Brain Signals Directly into Speech

WRITTEN BY: Nouran Amin

In Scientific Reports, neuro-engineers developed a system that translates thought into intelligible and recognizable speech through detections of brain activity that ultimately reconstruct the words a person hears with unprecedented clarity. The system can help people who cannot speak, those living with amyotrophic lateral sclerosis (ALS), or individuals recovering from stroke.

Concept illustration (stock image) via Science Daily  Credit: © adragan / Fotolia

"Our voices help connect us to our friends, family and the world around us, which is why losing the power of one's voice due to injury or disease is so devastating," says Nima Mesgarani, PhD, the paper's senior author and a principal investigator at Columbia University's Mortimer B. Zuckerman Mind Brain Behavior Institute. "With today's study, we have a potential way to restore that power. We've shown that, with the right technology, these people's thoughts could be decoded and understood by any listener."

Previous research has confirmed that when someone speaks or even thinking of saying something—patterns of brain activity begin to surface. Early efforts of the study focused on decoding brain signals through the utilization of computer models that analyzed spectrograms (the visual representations of sound frequencies). However, this approach has failed and so the study shifted to the use of a ‘vocoder’ which is a computer algorithm capable of synthesizing speech after being trained on voice recordings of human conversations

"This is the same technology used by Amazon Echo and Apple Siri to give verbal responses to our questions," said Dr. Mesgarani, who is also an associate professor of electrical engineering at Columbia's Fu Foundation School of Engineering and Applied Science. "Working with Dr. Ashesh Dinesh Mehta (co-author of the study), we asked epilepsy patients already undergoing brain surgery to listen to sentences spoken by different people, while we measured patterns of brain activity," said Dr. Mesgarani. "These neural patterns trained the vocoder."

Source: The Zuckerman Institute at Columbia University

About the Author
BS/MS
Nouran is a scientist, educator, and life-long learner with a passion for making science more communicable. When not busy in the lab isolating blood macrophages, she enjoys writing on various STEM topics.
You May Also Like
OCT 07, 2022
Space & Astronomy
Early Stellar Evolution Imprints in Stellar Oscillations
OCT 07, 2022
Early Stellar Evolution Imprints in Stellar Oscillations
A new study published in Nature Communications is shedding new light on the theory of stellar evolution. Astronomers at ...
OCT 18, 2022
Technology
Adding Scents to Virtual Reality Environments
OCT 18, 2022
Adding Scents to Virtual Reality Environments
Virtual reality has become an increasingly popular fixture in the popular imagination. Once thought of a sci-fi experien ...
OCT 24, 2022
Technology
3D Printing Breast Cancer Tumors
OCT 24, 2022
3D Printing Breast Cancer Tumors
Breast cancer is among the most common types of cancer, particularly among women. In fact, other than skin cancers, it i ...
OCT 23, 2022
Space & Astronomy
Black Hole "Wobble" Wobbles Researchers
OCT 23, 2022
Black Hole "Wobble" Wobbles Researchers
In a recent study published in Nature, an international team of researchers led by Cardiff University in the United King ...
NOV 14, 2022
Plants & Animals
Half of all palm tree species at risk of extinction
NOV 14, 2022
Half of all palm tree species at risk of extinction
Palm trees are a fixture of tropical locales. We often think of them when we think of warm vacation locations, including ...
NOV 30, 2022
Technology
New Tool Locates Origin of Epileptic Seizures, Improving Treatment
NOV 30, 2022
New Tool Locates Origin of Epileptic Seizures, Improving Treatment
Epilepsy, a condition that causes regular seizures, affects about 65 million people around the globe. Despite treatment ...
Loading Comments...