PT - JOURNAL ARTICLE AU - Andrew Jaegle AU - Vahid Mehrpour AU - Yalda Mohsenzadeh AU - Travis Meyer AU - Aude Oliva AU - Nicole Rust TI - A neural correlate of image memorability AID - 10.1101/535468 DP - 2019 Jan 01 TA - bioRxiv PG - 535468 4099 - http://biorxiv.org/content/early/2019/01/30/535468.short 4100 - http://biorxiv.org/content/early/2019/01/30/535468.full AB - Some images are easy to remember while others are easily forgotten. While variation in image memorability is consistent across individuals, we lack a full account of its neural correlates. By analyzing data collected from inferotemporal cortex (IT) as monkeys performed a visual memory task, we demonstrate that a simple property of the visual encoding of an image, its population response magnitude, is strongly correlated with its memorability. These results establish a novel behavioral role for the magnitude of the IT response, which lies largely orthogonal to the coding scheme that IT uses to represent object identity. To investigate the origin of IT memorability modulation, we also probed convolutional neural network models trained to categorize objects. We found brain-analogous correlates of memorability that grew in strength across the hierarchy of these networks, suggesting that this memorability correlate is likely to arise from the optimizations required for visual as opposed to mnemonic processing.