RT Journal Article
SR Electronic
T1 Revisiting the role of synaptic plasticity and network dynamics for fast learning in spiking neural networks
JF bioRxiv
FD Cold Spring Harbor Laboratory
SP 2021.01.25.428153
DO 10.1101/2021.01.25.428153
A1 Anand Subramoney
A1 Guillaume Bellec
A1 Franz Scherr
A1 Robert Legenstein
A1 Wolfgang Maass
YR 2021
UL http://biorxiv.org/content/early/2021/01/27/2021.01.25.428153.abstract
AB Spike-based neural network models have so far not been able to reproduce the capability of the brain to learn from very few, often even from just a single example. We show that this deficiency of models disappears if one allows synaptic weights to store priors and other information that optimize the learning process, while using the network state to quickly absorb information from new examples. For that, it suffices to include biologically realistic neurons with spike frequency adaptation in the neural network model, and to optimize the learning process through meta-learning. We demonstrate this on a variety of tasks, including fast learning and deletion of attractors, adaptation of motor control to changes in the body, and solving the Morris water maze task – a paradigm for fast learning of navigation to a new goal.Significance Statement It has often been conjectured that STDP or other rules for synaptic plasticity can only explain some of the learning capabilities of brains. In particular, learning a new task from few trials is likely to engage additional mechanisms. Results from machine learning show that artificial neural networks can learn from few trials by storing information about them in their network state, rather than encoding them in synaptic weights. But these machine learning methods require neural networks with biologically unrealistic LSTM (Long Short Term Memory) units. We show that biologically quite realistic models for neural networks of the brain can exhibit similar capabilities. In particular, these networks are able to store priors that enable learning from very few examples.Competing Interest StatementThe authors have declared no competing interest.