SEP 17, 2020 6:29 PM PDT

Advancing Memory in AI Neural Networks

WRITTEN BY: Nouran Amin

Improving The Memory of Neural Networks via Artificial intelligence (AI)

Using the human brain as inspiration, researchers at the University of Massachusetts Amherst and the Baylor College of Medicine have reported a way in improving neural network memory.

They write, "One solution would be to store previously encountered examples and revisit them when learning something new. Although such 'replay' or 'rehearsal' solves catastrophic forgetting," they add, "constantly retraining on all previously learned tasks is highly inefficient and the amount of data that would have to be stored becomes unmanageable quickly."

Naturally, humans are able to collect information and build on it through experiences. One way our brains remember old information is through a critical mechanism involving the ‘replay’ of neuronal activity.  This mechanism is not found in AI neuronal networks. Findings were published in Nature Communications.

Learn more about neural networks:

Hava Siegelmann at UMass Amherst notes, "recognizing that replay in the brain does not store data." Rather, "the brain generates representations of memories at a high, more abstract level with no need to generate detailed memories."

"We propose a new, brain-inspired variant of replay in which internal or hidden representations are replayed that are generated by the network's own, context-modulated feedback connections,” explains first author and postdoctoral researcher Gido van de Ven. “Our method achieves state-of-the-art performance on challenging continual learning benchmarks without storing data, and it provides a novel model for abstract level replay in the brain."

Findings were published in Nature Communications.

Source: Science Daily

About the Author
  • Nouran earned her BS and MS in Biology at IUPUI and currently shares her love of science by teaching. She enjoys writing on various topics as well including science & medicine, global health, and conservation biology. She hopes through her writing she can make science more engaging and communicable to the general public.
You May Also Like
AUG 13, 2020
Cardiology
Using Artificial Intelligence to Read Your ECG Results
AUG 13, 2020
Using Artificial Intelligence to Read Your ECG Results
An electrocardiogram (ECG) is a tool used to measure the heartbeat using an electrical current. By following the current ...
SEP 14, 2020
Clinical & Molecular DX
Cell Line Authentication Using STR Analysis
SEP 14, 2020
Cell Line Authentication Using STR Analysis
Imagine you’re studying colon cancer using a colon cell line model. After three painstaking years of research, you ...
SEP 24, 2020
Technology
What Drives Essential Sensing in Animals?
SEP 24, 2020
What Drives Essential Sensing in Animals?
What drives essential sensing in animals? Researchers at Northwestern University have developed a new theory that can pr ...
OCT 24, 2020
Immunology
New CRISPR-Based Imaging Tool Is Going to Be HiUGE
OCT 24, 2020
New CRISPR-Based Imaging Tool Is Going to Be HiUGE
A team of researchers at Duke University have developed an imaging technology for tagging structures at a cellular level ...
NOV 26, 2020
Technology
Bio-printing Lab Grown Kidneys
NOV 26, 2020
Bio-printing Lab Grown Kidneys
Scientists are now working to bioprinting kidneys in the lab for treatments of kidney failure. The research was led by a ...
DEC 10, 2020
Plants & Animals
3M Helps Solve Polar Bear Tracking Problem
DEC 10, 2020
3M Helps Solve Polar Bear Tracking Problem
As climate change continues to alter the Arctic landscape, polar bear research becomes more urgent. Observing animals in ...
Loading Comments...