PT - JOURNAL ARTICLE AU - Qiu, Yongrong AU - Klindt, David A. AU - Szatko, Klaudia P. AU - Gonschorek, Dominic AU - Hoefling, Larissa AU - Schubert, Timm AU - Busse, Laura AU - Bethge, Matthias AU - Euler, Thomas TI - Efficient coding of natural scenes improves neural system identification AID - 10.1101/2022.01.10.475663 DP - 2022 Jan 01 TA - bioRxiv PG - 2022.01.10.475663 4099 - http://biorxiv.org/content/early/2022/01/11/2022.01.10.475663.short 4100 - http://biorxiv.org/content/early/2022/01/11/2022.01.10.475663.full AB - Neural system identification aims at learning the response function of neurons to arbitrary stimuli using experimentally recorded data, but typically does not leverage coding principles such as efficient coding of natural environments. Visual systems, however, have evolved to efficiently process input from the natural environment. Here, we present a normative network regularization for system identification models by incorporating, as a regularizer, the efficient coding hypothesis, which states that neural response properties of sensory representations are strongly shaped by the need to preserve most of the stimulus information with limited resources. Using this approach, we explored if a system identification model can be improved by sharing its convolutional filters with those of an autoencoder which aims to efficiently encode natural stimuli. To this end, we built a hybrid model to predict the responses of retinal neurons to noise stimuli. This approach did not only yield a higher performance than the “stand-alone” system identification model, it also produced more biologically-plausible filters. We found these results to be consistent for retinal responses to different stimuli and across model architectures. Moreover, our normatively regularized model performed particularly well in predicting responses of direction-of-motion sensitive retinal neurons. In summary, our results support the hypothesis that efficiently encoding environmental inputs can improve system identification models of early visual processing.Significance Computational models use experimental data to learn stimulus-response functions of neurons, but they are rarely informed by normative coding principles, such as the idea that sensory neural systems have evolved to efficiently process natural stimuli. We here introduce a novel method to incorporate natural scene statistics to predict responses of retinal neurons to visual stimuli. We show that considering efficient representations of natural scenes improves the model’s predictive performance and produces biologically-plausible receptive fields. Generally, our approach provides a promising new framework to test various (normative) coding principles using experimental data for understanding the computations of biological neural networks.Competing Interest StatementThe authors have declared no competing interest.