Neuron
Volume 102, Issue 5, 5 June 2019, Pages 1076-1087.e8
Journal home page for Neuron

Article
Causal Inference in the Multisensory Brain

https://doi.org/10.1016/j.neuron.2019.03.043Get rights and content
Under an Elsevier user license
open archive

Highlights

  • Flexible use of multisensory information follows Bayesian inference

  • Sensory fusion emerges earlier than causal inference

  • Multisensory inference is represented in the frontal lobe

  • Inferior frontal regions guide perception in discrepant environments

Summary

When combining information across different senses, humans need to flexibly select cues of a common origin while avoiding distraction from irrelevant inputs. The brain could solve this challenge using a hierarchical principle by deriving rapidly a fused sensory estimate for computational expediency and, later and if required, filtering out irrelevant signals based on the inferred sensory cause(s). Analyzing time- and source-resolved human magnetoencephalographic data, we unveil a systematic spatiotemporal cascade of the relevant computations, starting with early segregated unisensory representations, continuing with sensory fusion in parietal-temporal regions, and culminating as causal inference in the frontal lobe. Our results reconcile previous computational accounts of multisensory perception by showing that prefrontal cortex guides flexible integrative behavior based on candidate representations established in sensory and association cortices, thereby framing multisensory integration in the generalized context of adaptive behavior.

Keywords

crossmodal
flexible behavior
sensory fusion
causal inference
decision making
structure inference
ventrolateral prefrontal cortex
parietal cortex
representational similarity analysis
magnetoencephalography
MEG

Cited by (0)

5

Senior author

6

Lead Contact