Skip to main content
bioRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search
New Results

It takes neurons to understand neurons: Digital twins of visual cortex synthesize neural metamers

Erick Cobos, View ORCID ProfileTaliah Muhammad, Paul G. Fahey, Zhiwei Ding, Zhuokun Ding, Jacob Reimer, View ORCID ProfileFabian H. Sinz, View ORCID ProfileAndreas S. Tolias
doi: https://doi.org/10.1101/2022.12.09.519708
Erick Cobos
1Baylor College of Medicine, Center for Neuroscience and Artificial Intelligence, Houston, 77030, United States
2Baylor College of Medicine, Department of Neuroscience, Houston, 77030, United States
3Max Planck Institute for Intelligent Systems, Empirical Inference Department, Tübingen, 72076, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Taliah Muhammad
2Baylor College of Medicine, Department of Neuroscience, Houston, 77030, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Taliah Muhammad
Paul G. Fahey
1Baylor College of Medicine, Center for Neuroscience and Artificial Intelligence, Houston, 77030, United States
2Baylor College of Medicine, Department of Neuroscience, Houston, 77030, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Zhiwei Ding
1Baylor College of Medicine, Center for Neuroscience and Artificial Intelligence, Houston, 77030, United States
2Baylor College of Medicine, Department of Neuroscience, Houston, 77030, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Zhuokun Ding
1Baylor College of Medicine, Center for Neuroscience and Artificial Intelligence, Houston, 77030, United States
2Baylor College of Medicine, Department of Neuroscience, Houston, 77030, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jacob Reimer
1Baylor College of Medicine, Center for Neuroscience and Artificial Intelligence, Houston, 77030, United States
2Baylor College of Medicine, Department of Neuroscience, Houston, 77030, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Fabian H. Sinz
1Baylor College of Medicine, Center for Neuroscience and Artificial Intelligence, Houston, 77030, United States
4University of Göttingen, Institute for Computer Science and Campus Institute Data Science (CIDAS), Göttingen 37077, Germany
5University of Tübingen, Institute for Bioinformatics and Medical Informatics, Tübingen, 72076, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Fabian H. Sinz
Andreas S. Tolias
1Baylor College of Medicine, Center for Neuroscience and Artificial Intelligence, Houston, 77030, United States
2Baylor College of Medicine, Department of Neuroscience, Houston, 77030, United States
6Department of Electrical and Computer Engineering, Rice University, Houston, United States
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Andreas S. Tolias
  • For correspondence: astolias@bcm.edu
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Preview PDF
Loading

ABSTRACT

Metamers, images that are perceived as equal, are a useful tool to study representations of natural images in biological and artificial vision systems. We synthesized metamers for the mouse visual system by inverting a deep encoding model to find an image that matched the observed neural activity to the original presented image. When testing the resulting images in physiological experiments we found that they most closely reproduced the neural activity of the original image when compared to other decoding methods, even when tested in a different animal whose neural activity was not used to produce the metamer. This demonstrates that deep encoding models do capture general characteristic properties of biological visual systems and can be used to define a meaningful perceptual loss for the visual system.

Competing Interest Statement

The authors have declared no competing interest.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-NC-ND 4.0 International license.
Back to top
PreviousNext
Posted December 12, 2022.
Download PDF
Email

Thank you for your interest in spreading the word about bioRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
It takes neurons to understand neurons: Digital twins of visual cortex synthesize neural metamers
(Your Name) has forwarded a page to you from bioRxiv
(Your Name) thought you would like to see this page from the bioRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
It takes neurons to understand neurons: Digital twins of visual cortex synthesize neural metamers
Erick Cobos, Taliah Muhammad, Paul G. Fahey, Zhiwei Ding, Zhuokun Ding, Jacob Reimer, Fabian H. Sinz, Andreas S. Tolias
bioRxiv 2022.12.09.519708; doi: https://doi.org/10.1101/2022.12.09.519708
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
It takes neurons to understand neurons: Digital twins of visual cortex synthesize neural metamers
Erick Cobos, Taliah Muhammad, Paul G. Fahey, Zhiwei Ding, Zhuokun Ding, Jacob Reimer, Fabian H. Sinz, Andreas S. Tolias
bioRxiv 2022.12.09.519708; doi: https://doi.org/10.1101/2022.12.09.519708

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Neuroscience
Subject Areas
All Articles
  • Animal Behavior and Cognition (4230)
  • Biochemistry (9123)
  • Bioengineering (6766)
  • Bioinformatics (23969)
  • Biophysics (12109)
  • Cancer Biology (9510)
  • Cell Biology (13753)
  • Clinical Trials (138)
  • Developmental Biology (7623)
  • Ecology (11674)
  • Epidemiology (2066)
  • Evolutionary Biology (15492)
  • Genetics (10631)
  • Genomics (14310)
  • Immunology (9473)
  • Microbiology (22822)
  • Molecular Biology (9086)
  • Neuroscience (48920)
  • Paleontology (355)
  • Pathology (1480)
  • Pharmacology and Toxicology (2566)
  • Physiology (3841)
  • Plant Biology (8322)
  • Scientific Communication and Education (1468)
  • Synthetic Biology (2295)
  • Systems Biology (6180)
  • Zoology (1299)