RT Journal Article
SR Electronic
T1 Generative replay for compositional visual understanding in the prefrontal-hippocampal circuit
JF bioRxiv
FD Cold Spring Harbor Laboratory
SP 2021.06.06.447249
DO 10.1101/2021.06.06.447249
A1 Schwartenbeck, Philipp
A1 Baram, Alon
A1 Liu, Yunzhe
A1 Mark, Shirley
A1 Muller, Timothy
A1 Dolan, Raymond
A1 Botvinick, Matthew
A1 Kurth-Nelson, Zeb
A1 Behrens, Timothy
YR 2021
UL http://biorxiv.org/content/early/2021/06/06/2021.06.06.447249.abstract
AB Understanding the visual world is a constructive process. Whilst a frontal-hippocampal circuit is known to be essential for this task, little is known about the associated neuronal computations. Visual understanding appears superficially distinct from other known functions of this circuit, such as spatial reasoning and model-based planning, but recent models suggest deeper computational similarities. Here, using fMRI, we show that representations of a simple visual scene in these brain regions are relational and compositional – key computational properties theorised to support rapid construction of hippocampal maps. Using MEG, we show that rapid sequences of representations, akin to replay in spatial navigation and planning problems, are also engaged in visual construction. Whilst these sequences have previously been proposed as mechanisms to plan possible futures or learn from the past, here they are used to understand the present. Replay sequences form constructive hypotheses about possible scene configurations. These hypotheses play out in an optimal order for relational inference, progressing from predictable to uncertain scene elements, gradually constraining possible configurations, and converging on the correct scene configuration. Together, these results suggest a computational bridge between apparently distinct functions of hippocampal-prefrontal circuitry, and a role for generative replay in constructive inference and hypothesis testing.Competing Interest StatementThe authors have declared no competing interest.