RT Journal Article
SR Electronic
T1 Evolving super stimuli for real neurons using deep generative networks
JF bioRxiv
FD Cold Spring Harbor Laboratory
SP 516484
DO 10.1101/516484
A1 Carlos R. Ponce
A1 Will Xiao
A1 Peter F. Schade
A1 Till S. Hartmann
A1 Gabriel Kreiman
A1 Margaret S. Livingstone
YR 2019
UL http://biorxiv.org/content/early/2019/01/17/516484.abstract
AB Finding the best stimulus for a neuron is challenging because it is impossible to test all possible stimuli. Here we used a vast, unbiased, and diverse hypothesis space encoded by a generative deep neural network model to investigate neuronal selectivity in inferotemporal cortex without making any assumptions about natural features or categories. A genetic algorithm, guided by neuronal responses, searched this space for optimal stimuli. Evolved synthetic images evoked higher firing rates than even the best natural images and revealed diagnostic features, independently of category or feature selection. This approach provides a way to investigate neural selectivity in any modality that can be represented by a neural network and challenges our understanding of neural coding in visual cortex.A generative deep neural network interacted with a genetic algorithm to evolve stimuli that maximized the firing of neurons in alert macaque inferotemporal and primary visual cortex.The evolved images activated neurons more strongly than did thousands of natural images.Distance in image space from the evolved images predicted responses of neurons to novel images.