Skip to main content
bioRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search
New Results

Deep convolutional models improve predictions of macaque V1 responses to natural images

Santiago A. Cadena, George H. Denfield, Edgar Y. Walker, Leon A. Gatys, Andreas S. Tolias, Matthias Bethge, Alexander S. Ecker
doi: https://doi.org/10.1101/201764
Santiago A. Cadena
1Centre for Integrative Neuroscience and Institute for Theoretical Physics, University of Tübingen, Germany
3Bernstein Center for Computational Neuroscience, Tübingen, Germany
6Center for Neuroscience and Artificial Intelligence, BCM. Houston, TX, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: santiago.cadena@bethgelab.org
George H. Denfield
4Department of Neuroscience, Baylor College of Medicine, Houston, TX, USA
6Center for Neuroscience and Artificial Intelligence, BCM. Houston, TX, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Edgar Y. Walker
4Department of Neuroscience, Baylor College of Medicine, Houston, TX, USA
6Center for Neuroscience and Artificial Intelligence, BCM. Houston, TX, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Leon A. Gatys
1Centre for Integrative Neuroscience and Institute for Theoretical Physics, University of Tübingen, Germany
3Bernstein Center for Computational Neuroscience, Tübingen, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Andreas S. Tolias
3Bernstein Center for Computational Neuroscience, Tübingen, Germany
4Department of Neuroscience, Baylor College of Medicine, Houston, TX, USA
5Department of Electrical and Computer Engineering, Rice University, Houston, TX, USA
6Center for Neuroscience and Artificial Intelligence, BCM. Houston, TX, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Matthias Bethge
1Centre for Integrative Neuroscience and Institute for Theoretical Physics, University of Tübingen, Germany
2Max Planck Institute for Biological Cybernetics, Tübingen, Germany
3Bernstein Center for Computational Neuroscience, Tübingen, Germany
6Center for Neuroscience and Artificial Intelligence, BCM. Houston, TX, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Alexander S. Ecker
1Centre for Integrative Neuroscience and Institute for Theoretical Physics, University of Tübingen, Germany
3Bernstein Center for Computational Neuroscience, Tübingen, Germany
6Center for Neuroscience and Artificial Intelligence, BCM. Houston, TX, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Preview PDF
Loading

Abstract

Despite great efforts over several decades, our best models of primary visual cortex (V1) still predict neural responses quite poorly when probed with natural stimuli, highlighting our limited understanding of the nonlinear computations in V1. At the same time, recent advances in machine learning have shown that deep neural networks can learn highly nonlinear functions for visual information processing. Two approaches based on deep learning have recently been successfully applied to neural data: transfer learning for predicting neural activity in higher areas of the primate ventral stream and data-driven models to predict retina and V1 neural activity of mice. However, so far there exists no comparison between the two approaches and neither of them has been used to model the early primate visual system. Here, we test the ability of both approaches to predict neural responses to natural images in V1 of awake monkeys. We found that both deep learning approaches outperformed classical linear-nonlinear and wavelet-based feature representations building on existing V1 encoding theories. On our dataset, transfer learning and data-driven models performed similarly, while the data-driven model employed a much simpler architecture. Thus, multi-layer CNNs set the new state of the art for predicting neural responses to natural images in primate V1. Having such good predictive in-silico models opens the door for quantitative studies of yet unknown nonlinear computations in V1 without being limited by the available experimental time.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY 4.0 International license.
Back to top
PreviousNext
Posted October 11, 2017.
Download PDF
Email

Thank you for your interest in spreading the word about bioRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Deep convolutional models improve predictions of macaque V1 responses to natural images
(Your Name) has forwarded a page to you from bioRxiv
(Your Name) thought you would like to see this page from the bioRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Deep convolutional models improve predictions of macaque V1 responses to natural images
Santiago A. Cadena, George H. Denfield, Edgar Y. Walker, Leon A. Gatys, Andreas S. Tolias, Matthias Bethge, Alexander S. Ecker
bioRxiv 201764; doi: https://doi.org/10.1101/201764
Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
Citation Tools
Deep convolutional models improve predictions of macaque V1 responses to natural images
Santiago A. Cadena, George H. Denfield, Edgar Y. Walker, Leon A. Gatys, Andreas S. Tolias, Matthias Bethge, Alexander S. Ecker
bioRxiv 201764; doi: https://doi.org/10.1101/201764

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Neuroscience
Subject Areas
All Articles
  • Animal Behavior and Cognition (3479)
  • Biochemistry (7318)
  • Bioengineering (5296)
  • Bioinformatics (20197)
  • Biophysics (9976)
  • Cancer Biology (7703)
  • Cell Biology (11250)
  • Clinical Trials (138)
  • Developmental Biology (6418)
  • Ecology (9916)
  • Epidemiology (2065)
  • Evolutionary Biology (13280)
  • Genetics (9352)
  • Genomics (12554)
  • Immunology (7674)
  • Microbiology (18939)
  • Molecular Biology (7417)
  • Neuroscience (40893)
  • Paleontology (298)
  • Pathology (1226)
  • Pharmacology and Toxicology (2126)
  • Physiology (3140)
  • Plant Biology (6838)
  • Scientific Communication and Education (1270)
  • Synthetic Biology (1891)
  • Systems Biology (5296)
  • Zoology (1085)