PT  - JOURNAL ARTICLE
AU  - Radoslaw Martin Cichy
AU  - Aditya Khosla
AU  - Dimitrios Pantazis
AU  - Aude Oliva
TI  - Dynamics of scene representations in the human brain revealed by magnetoencephalography and deep neural networks
AID  - 10.1101/032623
DP  - 2015 Jan 01
TA  - bioRxiv
PG  - 032623
4099  - http://biorxiv.org/content/early/2015/11/23/032623.short
4100  - http://biorxiv.org/content/early/2015/11/23/032623.full
AB  - Human scene recognition is a rapid multistep process evolving over time from single scene image to spatial layout processing. We used multivariate pattern analyses on magnetoencephalography (MEG) data to unravel the time course of this cortical process. Following an early signal for lower-level visual analysis of single scenes at ~100ms, we found a marker of real-world scene size, i.e. spatial layout processing, at ~250ms indexing neural representations robust to changes in unrelated scene properties and viewing conditions. For a quantitative explanation that captures the complexity of scene recognition, we compared MEG data to a deep neural network model trained on scene classification. Representations of scene size emerged intrinsically in the model, and resolved emerging neural scene size representation. Together our data provide a first description of an electrophysiological signal for layout processing in humans, and a novel quantitative model of how spatial layout representations may emerge in the human brain.