Skip to main content
bioRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search
New Results

Transferring and Generalizing Deep-Learning-based Neural Encoding Models across Subjects

Haiguang Wen, Junxing Shi, Wei Chen, Zhongming Liu
doi: https://doi.org/10.1101/171017
Haiguang Wen
School of Electrical and Computer Engineering, Purdue University, West Lafayette, Indiana, 47906, USA.Purdue Institute for Integrative Neuroscience, Purdue University, West Lafayette, Indiana, 47906, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Junxing Shi
School of Electrical and Computer Engineering, Purdue University, West Lafayette, Indiana, 47906, USA.Purdue Institute for Integrative Neuroscience, Purdue University, West Lafayette, Indiana, 47906, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Wei Chen
Center for Magnetic Resonance Research, Department of Radiology, University of Minnesota Medical School, Minneapolis, MN, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Zhongming Liu
Weldon School of Biomedical Engineering, Purdue University, West Lafayette, Indiana, 47906, USA.School of Electrical and Computer Engineering, Purdue University, West Lafayette, Indiana, 47906, USA.Purdue Institute for Integrative Neuroscience, Purdue University, West Lafayette, Indiana, 47906, USA.
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: zmliu@purdue.edu
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Preview PDF
Loading

Abstract

Recent studies have shown the value of using deep learning models for mapping and characterizing how the brain represents and organizes information for natural vision. However, modeling the relationship between deep learning models and the brain (or encoding models), requires measuring cortical responses to large and diverse sets of natural visual stimuli from single subjects. This requirement limits prior studies to few subjects, making it difficult to generalize findings across subjects or for a population. In this study, we developed new methods to transfer and generalize encoding models across subjects. To train encoding models specific to a subject, the models trained for other subjects were used as the prior models and were refined efficiently using Bayesian inference with a limited amount of data from the specific subject. To train encoding models for a population, the models were progressively trained and updated with incremental data from different subjects. For the proof of principle, we applied these methods to functional magnetic resonance imaging (fMRI) data from three subjects watching tens of hours of naturalistic videos, while deep residual neural network driven by image recognition was used to model the visual cortical processing. Results demonstrate that the methods developed herein provide an efficient and effective strategy to establish subject-specific or populationwide predictive models of cortical representations of high-dimensional and hierarchical visual features.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. All rights reserved. No reuse allowed without permission.
Back to top
PreviousNext
Posted August 01, 2017.
Download PDF

Supplementary Material

Email

Thank you for your interest in spreading the word about bioRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Transferring and Generalizing Deep-Learning-based Neural Encoding Models across Subjects
(Your Name) has forwarded a page to you from bioRxiv
(Your Name) thought you would like to see this page from the bioRxiv website.
Share
Transferring and Generalizing Deep-Learning-based Neural Encoding Models across Subjects
Haiguang Wen, Junxing Shi, Wei Chen, Zhongming Liu
bioRxiv 171017; doi: https://doi.org/10.1101/171017
Digg logo Reddit logo Twitter logo CiteULike logo Facebook logo Google logo Mendeley logo
Citation Tools
Transferring and Generalizing Deep-Learning-based Neural Encoding Models across Subjects
Haiguang Wen, Junxing Shi, Wei Chen, Zhongming Liu
bioRxiv 171017; doi: https://doi.org/10.1101/171017

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Neuroscience
Subject Areas
All Articles
  • Animal Behavior and Cognition (1526)
  • Biochemistry (2480)
  • Bioengineering (1739)
  • Bioinformatics (9683)
  • Biophysics (3903)
  • Cancer Biology (2972)
  • Cell Biology (4195)
  • Clinical Trials (135)
  • Developmental Biology (2627)
  • Ecology (4102)
  • Epidemiology (2031)
  • Evolutionary Biology (6898)
  • Genetics (5206)
  • Genomics (6501)
  • Immunology (2184)
  • Microbiology (6945)
  • Molecular Biology (2752)
  • Neuroscience (17281)
  • Paleontology (126)
  • Pathology (427)
  • Pharmacology and Toxicology (706)
  • Physiology (1057)
  • Plant Biology (2489)
  • Scientific Communication and Education (643)
  • Synthetic Biology (831)
  • Systems Biology (2689)
  • Zoology (430)