PT - JOURNAL ARTICLE AU - Courtney J. Spoerer AU - Patrick McClure AU - Nikolaus Kriegeskorte TI - Recurrent convolutional neural networks: a better model of biological object recognition under occlusion AID - 10.1101/133330 DP - 2017 Jan 01 TA - bioRxiv PG - 133330 4099 - http://biorxiv.org/content/early/2017/05/02/133330.short 4100 - http://biorxiv.org/content/early/2017/05/02/133330.full AB - Feedforward neural networks provide the dominant model of how the brain performs visual object recognition. However, these networks lack the lateral and feedback connections, and the resulting recurrent neuronal dynamics, of the ventral visual pathway in the human and nonhuman primate brain. Here we investigate recurrent convolutional neural networks with bottom-up (B), lateral (L), and top-down (T) connections. Combining these types of connections yields four architectures (B, BT, BL, and BLT), which we systematically test and compare. We hypothesized that recurrent dynamics might improve recognition performance in the challenging scenario of partial occlusion. We introduce two novel occluded object recognition tasks to test the efficacy of the models, digit clutter (where multiple target digits occlude one another) and digit debris (where target digits are occluded by digit fragments). We find that recurrent neural networks outperform feedforward control models (approximately matched in parametric complexity) at recognising objects, both in the absence of occlusion and in all occlusion conditions. Recurrent neural networks are not only more neurobiologically plausible in their architecture; their dynamics also afford superior task performance. This work shows that computer vision can benefit from using recurrent convolutional architectures and suggests that the ubiquitous recurrent connections in biological brains are essential for task performance.