Skip to main content
bioRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search
New Results

Task-driven hierarchical deep neural network models of the proprioceptive pathway

View ORCID ProfileKai J. Sandbrink, View ORCID ProfilePranav Mamidanna, Claudio Michaelis, Mackenzie Weygandt Mathis, View ORCID ProfileMatthias Bethge, View ORCID ProfileAlexander Mathis
doi: https://doi.org/10.1101/2020.05.06.081372
Kai J. Sandbrink
1The Rowland Institute at Harvard, Harvard University, Cambridge, MA USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Kai J. Sandbrink
Pranav Mamidanna
2Institute for Theoretical Physics, Werner Reichardt Center for Integrative Neuroscience, Eberhard Karls Universität Tübingen, Tübingen, Germany
3Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Pranav Mamidanna
Claudio Michaelis
2Institute for Theoretical Physics, Werner Reichardt Center for Integrative Neuroscience, Eberhard Karls Universität Tübingen, Tübingen, Germany
4Tübingen AI Center, Tübingen, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Mackenzie Weygandt Mathis
1The Rowland Institute at Harvard, Harvard University, Cambridge, MA USA
2Institute for Theoretical Physics, Werner Reichardt Center for Integrative Neuroscience, Eberhard Karls Universität Tübingen, Tübingen, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Matthias Bethge
2Institute for Theoretical Physics, Werner Reichardt Center for Integrative Neuroscience, Eberhard Karls Universität Tübingen, Tübingen, Germany
4Tübingen AI Center, Tübingen, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Matthias Bethge
Alexander Mathis
1The Rowland Institute at Harvard, Harvard University, Cambridge, MA USA
2Institute for Theoretical Physics, Werner Reichardt Center for Integrative Neuroscience, Eberhard Karls Universität Tübingen, Tübingen, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Alexander Mathis
  • For correspondence: amathis@fas.harvard.edu
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Preview PDF
Loading

Abstract

Biological motor control is versatile and efficient. Muscles are flexible and undergo continuous changes requiring distributed adaptive control mechanisms. How proprioception solves this problem in the brain is unknown. Here we pursue a task-driven modeling approach that has provided important insights into other sensory systems. However, unlike for vision and audition where large annotated datasets of raw images or sound are readily available, data of relevant proprioceptive stimuli are not. We generated a large-scale dataset of human arm trajectories as the hand is tracing the alphabet in 3D space, then using a musculoskeletal model derived the spindle firing rates during these movements. We propose an action recognition task that allows training of hierarchical models to classify the character identity from the spindle firing patterns. Artificial neural networks could robustly solve this task, and the networks’ units show directional movement tuning akin to neurons in the primate somatosensory cortex. The same architectures with random weights also show similar kinematic feature tuning but do not reproduce the diversity of preferred directional tuning nor do they have invariant tuning across 3D space. Taken together our model is the first to link tuning properties in the proprioceptive system to the behavioral level.

Highlights

  • We provide a normative approach to derive neural tuning of proprioceptive features from behaviorally-defined objectives.

  • We propose a method for creating a scalable muscle spindles dataset based on kinematic data and define an action recognition task as a benchmark.

  • Hierarchical neural networks solve the recognition task from muscle spindle inputs.

  • Individual neural network units in middle layers resemble neurons in primate somatosensory cortex & make predictions for neurons along the proprioceptive pathway.

Competing Interest Statement

The authors have declared no competing interest.

Footnotes

  • ↵5 alexander.mathis{at}epfl.ch

  • ↵† co-first authors;

  • ↵* co-senior authors;

  • Updates to discussion

Copyright 
The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC 4.0 International license.
Back to top
PreviousNext
Posted May 26, 2020.
Download PDF
Email

Thank you for your interest in spreading the word about bioRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Task-driven hierarchical deep neural network models of the proprioceptive pathway
(Your Name) has forwarded a page to you from bioRxiv
(Your Name) thought you would like to see this page from the bioRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Task-driven hierarchical deep neural network models of the proprioceptive pathway
Kai J. Sandbrink, Pranav Mamidanna, Claudio Michaelis, Mackenzie Weygandt Mathis, Matthias Bethge, Alexander Mathis
bioRxiv 2020.05.06.081372; doi: https://doi.org/10.1101/2020.05.06.081372
Digg logo Reddit logo Twitter logo Facebook logo Google logo LinkedIn logo Mendeley logo
Citation Tools
Task-driven hierarchical deep neural network models of the proprioceptive pathway
Kai J. Sandbrink, Pranav Mamidanna, Claudio Michaelis, Mackenzie Weygandt Mathis, Matthias Bethge, Alexander Mathis
bioRxiv 2020.05.06.081372; doi: https://doi.org/10.1101/2020.05.06.081372

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Neuroscience
Subject Areas
All Articles
  • Animal Behavior and Cognition (4112)
  • Biochemistry (8814)
  • Bioengineering (6518)
  • Bioinformatics (23459)
  • Biophysics (11789)
  • Cancer Biology (9206)
  • Cell Biology (13322)
  • Clinical Trials (138)
  • Developmental Biology (7435)
  • Ecology (11409)
  • Epidemiology (2066)
  • Evolutionary Biology (15149)
  • Genetics (10436)
  • Genomics (14043)
  • Immunology (9170)
  • Microbiology (22152)
  • Molecular Biology (8811)
  • Neuroscience (47565)
  • Paleontology (350)
  • Pathology (1428)
  • Pharmacology and Toxicology (2491)
  • Physiology (3730)
  • Plant Biology (8079)
  • Scientific Communication and Education (1437)
  • Synthetic Biology (2220)
  • Systems Biology (6037)
  • Zoology (1253)