Skip to main content
bioRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search
New Results

The covariance perceptron: A new paradigm for classification and processing of time series in recurrent neuronal networks

View ORCID ProfileM Gilson, D Dahmen, R Moreno-Bote, A Insabato, M Helias
doi: https://doi.org/10.1101/562546
M Gilson
1Universitat Pompeu Fabra
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for M Gilson
  • For correspondence: matthieu.gilson@upf.edu
D Dahmen
2Juelich Forschungzentrum (Germany)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
R Moreno-Bote
3Universitat Pompeu Fabra (Barcelona, Spain)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
A Insabato
3Universitat Pompeu Fabra (Barcelona, Spain)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
M Helias
2Juelich Forschungzentrum (Germany)
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Preview PDF
Loading

Abstract

Learning in neuronal networks has developed in many directions, from image recognition and speech processing to data analysis in general. Most theories that rely on gradient descents tune the connection weights to map a set of input signals to a set of activity levels in the output of the network, thereby focusing on the first-order statistics of the network activity. Fluctuations around the desired activity level constitute noise in this view. Here we propose a conceptual change of perspective by employing temporal variability to represent the information to be learned, rather than merely being the noise that corrupts the mean signal. The new paradigm tunes both afferent and recurrent weights in a network to shape the input-output mapping for covariances, the second-order statistics of the fluctuating activity. When including time lags, covariance patterns define a natural metric for time series that capture their propagating nature. Notably, this viewpoint differs from recent studies that focused on noise correlation and (de)coding, because the activity variability here is the basis for stimulus-related information to be learned by neurons. We develop the theory for classification of time series based on their spatio-temporal covariances, which reflect dynamical properties. Closed-form expressions reveal identical pattern capacity in a binary classification task compared to the ordinary perceptron. The information density, however, exceeds the classical counterpart by a factor equal to the number of input neurons. We finally demonstrate the crucial importance of recurrent connectivity for transforming spatio-temporal covariances to spatial covariances.

Footnotes

  • new result on recurrent connections corrections of typos

Copyright 
The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted June 26, 2019.
Download PDF
Email

Thank you for your interest in spreading the word about bioRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
The covariance perceptron: A new paradigm for classification and processing of time series in recurrent neuronal networks
(Your Name) has forwarded a page to you from bioRxiv
(Your Name) thought you would like to see this page from the bioRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
The covariance perceptron: A new paradigm for classification and processing of time series in recurrent neuronal networks
M Gilson, D Dahmen, R Moreno-Bote, A Insabato, M Helias
bioRxiv 562546; doi: https://doi.org/10.1101/562546
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
The covariance perceptron: A new paradigm for classification and processing of time series in recurrent neuronal networks
M Gilson, D Dahmen, R Moreno-Bote, A Insabato, M Helias
bioRxiv 562546; doi: https://doi.org/10.1101/562546

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Neuroscience
Subject Areas
All Articles
  • Animal Behavior and Cognition (4235)
  • Biochemistry (9136)
  • Bioengineering (6784)
  • Bioinformatics (24001)
  • Biophysics (12129)
  • Cancer Biology (9534)
  • Cell Biology (13778)
  • Clinical Trials (138)
  • Developmental Biology (7636)
  • Ecology (11702)
  • Epidemiology (2066)
  • Evolutionary Biology (15513)
  • Genetics (10644)
  • Genomics (14326)
  • Immunology (9483)
  • Microbiology (22839)
  • Molecular Biology (9090)
  • Neuroscience (48995)
  • Paleontology (355)
  • Pathology (1482)
  • Pharmacology and Toxicology (2570)
  • Physiology (3846)
  • Plant Biology (8331)
  • Scientific Communication and Education (1471)
  • Synthetic Biology (2296)
  • Systems Biology (6192)
  • Zoology (1301)