SEP 17, 2020 6:29 PM PDT

Advancing Memory in AI Neural Networks

WRITTEN BY: Nouran Amin

Improving The Memory of Neural Networks via Artificial intelligence (AI)

Using the human brain as inspiration, researchers at the University of Massachusetts Amherst and the Baylor College of Medicine have reported a way in improving neural network memory.

They write, "One solution would be to store previously encountered examples and revisit them when learning something new. Although such 'replay' or 'rehearsal' solves catastrophic forgetting," they add, "constantly retraining on all previously learned tasks is highly inefficient and the amount of data that would have to be stored becomes unmanageable quickly."

Naturally, humans are able to collect information and build on it through experiences. One way our brains remember old information is through a critical mechanism involving the ‘replay’ of neuronal activity.  This mechanism is not found in AI neuronal networks. Findings were published in Nature Communications.

Learn more about neural networks:

Hava Siegelmann at UMass Amherst notes, "recognizing that replay in the brain does not store data." Rather, "the brain generates representations of memories at a high, more abstract level with no need to generate detailed memories."

"We propose a new, brain-inspired variant of replay in which internal or hidden representations are replayed that are generated by the network's own, context-modulated feedback connections,” explains first author and postdoctoral researcher Gido van de Ven. “Our method achieves state-of-the-art performance on challenging continual learning benchmarks without storing data, and it provides a novel model for abstract level replay in the brain."

Findings were published in Nature Communications.

Source: Science Daily

About the Author
BS/MS
Nouran is a scientist, educator, and life-long learner with a passion for making science more communicable. When not busy in the lab isolating blood macrophages, she enjoys writing on various STEM topics.
You May Also Like
OCT 09, 2022
Earth & The Environment
Scientists Upcycle Plastics to Fight Climate Change
OCT 09, 2022
Scientists Upcycle Plastics to Fight Climate Change
In a recent study published in the Journal of the American Chemical Society, a team of researchers led by the University ...
OCT 17, 2022
Technology
Converting A Light Breeze into Electricity
OCT 17, 2022
Converting A Light Breeze into Electricity
In a recent study published in Mechanical Systems and Signal Processing, a team of researchers from Nanyang Technologica ...
NOV 16, 2022
Space & Astronomy
Where Did the Planets Go?
NOV 16, 2022
Where Did the Planets Go?
A new study published in the Astrophysical Journal Letters presents a solution to some mysterious patterns that have sho ...
NOV 23, 2022
Earth & The Environment
The Ecological Impact of Wind Energy
NOV 23, 2022
The Ecological Impact of Wind Energy
In a recent study published in Biological Conservation, an international team of researchers led by UC Santa Cruz examin ...
NOV 26, 2022
Space & Astronomy
Could We Find Life in Caves Off Earth?
NOV 26, 2022
Could We Find Life in Caves Off Earth?
In two connected studies published in the Journal of Geophysical Research: Planets, “Fundamental Science and Engin ...
NOV 22, 2022
Technology
Specialized MRI Shows Post-COVID Brain Changes
NOV 22, 2022
Specialized MRI Shows Post-COVID Brain Changes
Since the start of the pandemic, researchers have learned a lot about the health effects of COVID-19 infection. In parti ...
Loading Comments...