A social Bayesian brain: How social knowledge can shape visual perception
Introduction
Humans are intensely social animals: social interaction in all shapes and sizes forms a core aspect of our existence. The things we know, both consciously (explicitly) and unconsciously (implicitly), about other people helps us to swiftly interpret their behaviour and respond appropriately. In recent years, evidence has mounted that social knowledge shapes not just how we interpret the world around us, but also how we perceive it (see for example Barrett & Bar, 2009). Research from experimental social psychology focussing mainly on visual perception suggests that social contextual factors can subtly but substantially change how a stimulus is processed, which in turn changes the percept that people experience. In this paper, we provide an overview of the experimental evidence that social contextual factors such as goals, desires, emotions, social interpersonal knowledge and stereotypes can significantly influence even the earliest stages of perception. Even though social psychologists have made great strides in uncovering these early perceptual influences of social context, within social psychology there has been a lack of theoretical frameworks in which these findings can be organised. Standard models of human perception emphasize a bottom-up elaboration of sensory information, which imply that higher-level factors such as social context only have a role in later stages, after the corresponding perceptual content has been established. Here, we explore how “predictive perception”, based on the view of the human brain as a pro-active Bayesian hypothesis tester, provides a powerful theoretical framework in which to assimilate the body of experimental findings from social psychology that is now emerging. A key feature of this framework is its emphasis on bidirectional influences between incoming sensory data and prior expectations about the causes of this data (Clark, 2013, Friston, 2010, Hohwy, 2013, Seth, 2013). This allows researchers studying social cognition to frame questions about whether social context directly affects perceptual content, or whether it (merely) alters post-perceptual processes. In this way, this framework provides a strong basis from which to derive new, testable hypotheses that stand to substantially enrich the field of social psychological research.
Section snippets
Social perception
The idea that high-level social factors such as attitudes, goals and stereotypes can change low level perceptual processes is not new. In the mid-20th century the “New Look” movement made the case that social processes critically change basic cognitive functioning (Bruner, 1992). For example, Bruner and Goodman (Bruner & Goodman, 1947) showed that children from poor homes overestimated the size of coins compared to wealthy children. Unfortunately, in subsequent years, many of the New Look
Predictive perception
The visual system is serially attuned to sensory processing: hierarchically low levels are preferentially activated by local details, while hierarchically higher level visual areas respond to information that needs to be integrated and combined over larger visual angles (Van Essen et al., 1992, Zeki et al., 1991). This serial architecture has been the basis for an almost implicit assumption that visual processing is a serial, bottom-up process (Hochstein and Ahissar, 2002, Hubel and Wiesel, 1968
Implications for social perception
As described above, the essence of the predictive processing framework is that prior experience and existing knowledge constrains predictions about the causes of current sensory inputs. By combining priors with the actual sensory input, perceptual content is specified. Within such a framework, desires, goals, emotional states and individual or group-level social knowledge about others all have a potential
Conclusion
After a hiatus, social psychology has again turned its focus to exploring the interaction between high-level social knowledge and basic perceptual processing. At this point, evidence is mounting that a person’s desires and moods, and their knowledge about individuals and groups, can shape perceptual content. Adopting a view of human perception as a predictive process, that relies on internally generated predictions or priors, can not only explain how social knowledge can directly and seamlessly
References (107)
- et al.
What you feel influences what you see: The role of affective feelings in resolving binocular rivalry
Journal of Experimental Social Psychology
(2011) - et al.
Subjective value determines initial dominance in binocular rivalry
Journal of Experimental Social Psychology
(2012) The proactive brain: Using analogies and associations to generate predictions
Trends in Cognitive Sciences
(2007)- et al.
Canonical microcircuits for predictive coding
Neuron
(2012) - et al.
Probabilistic population codes for Bayesian decision making
Neuron
(2008) - et al.
Cross-modal prediction changes the timing of conscious access during the motion-induced blindness
Consciousness and Cognition
(2015) - et al.
What and where: A Bayesian inference theory of attention
Vision Research
(2010) - et al.
The power of simulation: Imagining one’s own and other’s behavior
Brain Research
(2006) - et al.
Virtual prejudice
Journal of Experimental Social Psychology
(2008) The free-energy principle: A rough guide to the brain?
Trends in Cognitive Sciences
(2009)
“Did you see him in the newspaper?” Electrophysiological correlates of context and valence in face processing
Brain Research
View from the top: Hierarchies and reverse hierarchies in the visual system
Neuron
Gender stereotypes and assumptions about expertise in transactive memory
Journal of Experimental Social Psychology
Learning receptive fields using predictive feedback
Journal of Physiology – Paris
The Bayesian brain: The role of uncertainty in neural coding and computation
Trends in Neurosciences
Less is more: Expectation sharpens representations in the primary visual cortex
Neuron
Theory of mind: A neural prediction problem
Neuron
Convergence and divergence in a neural architecture for recognition and memory
Trends in Neurosciences
When the world becomes ‘too real’: A Bayesian explanation of autistic perception
Trends in Cognitive Sciences
Neurophysiology of shape processing
Image and Vision Computing
Autism, oxytocin and interoception
Neuroscience & Biobehavioral Reviews
The communicative style of a speaker can affect language comprehension? ERP evidence from the comprehension of irony
Brain Research
Interoceptive inference, emotion, and the embodied self
Trends in Cognitive Sciences
Reflections on agranular architecture: Predictive coding in the motor cortex
Trends in Neurosciences
Neural bases of binocular rivalry
Trends in Cognitive Sciences
The turban effect: The influence of muslim headgear and induced affect on aggressive responses in the shooter bias paradigm
Journal of Experimental Social Psychology
Varieties of cognitive penetration in visual perception
Consciousness and Cognition
Distributed and interactive brain mechanisms during emotion face perception: Evidence from functional neuroimaging
Neuropsychologia
Smooth pursuit and visual occlusion: Active inference and oculomotor control in schizophrenia
PloS one
Predictions not commands: Active inference in the motor system
Brain Structure and Function
Measuring perception without introspection
Journal of Vision
The visual impact of gossip
Science
See what you want to see: Motivational influences on visual perception
Journal of Personality and Social Psychology
See it with feeling: Affective predictions during object perception
Philosophical Transactions of the Royal Society B: Biological Sciences
Interoceptive predictions in the brain
Nature Reviews Neuroscience
Situated simulation in the human conceptual system
Language and Cognitive Processes
Grounded cognition
Annual Review of Psychology
A primer on binocular rivalry, including current controversies
Brain and Mind
Crossing racial boundaries: A closer look at the roots of racial bias in capital sentencing when the defendant is black and the victim is white
DePaul Law Review
Active inference, sensory attenuation and illusions
Cognitive Processing
Another look at new look 1
American Psychologist
Value and need as organizing factors in perception
The Journal of Abnormal and Social Psychology
Whatever next? predictive brains, situated agents, and the future of cognitive science
Behavioral and Brain Sciences
The police officer’s dilemma: Using ethnicity to disambiguate potentially threatening individuals
Journal of Personality and Social Psychology
Seeing black: Race, crime, and visual processing
Journal of Personality and Social Psychology
The good news-bad news effect: Asymmetric processing of objective information about yourself
American Economic Journal: Microeconomics
A new look at the new look: Perceptual defense and vigilance
Psychological Review
Figments, fantasies, and follies: A search for the subconscious mind1
Journal of Personality
Prediction, explanation, and the role of generative models in language processing
Behavioral and Brain Sciences
Attention, uncertainty, and free-energy
Frontiers in Human Neuroscience
Cited by (70)
Motivation and prediction-driven processing of social memoranda
2024, Neuroscience and Biobehavioral ReviewsMining attention distribution paradigm: Discover gaze patterns and their association rules behind the visual image
2023, Computer Methods and Programs in BiomedicineTowards tacit knowledge mining within context: Visual cognitive graph model and eye movement image interpretation
2022, Computer Methods and Programs in BiomedicineCitation Excerpt :Here context information is used as a latent state of a Markov process [39]. In [35], the authors utilize Bayesian theory to demonstrate an understanding of the underlying mechanisms suggesting typicalities in evaluating probabilistic links within the perceptual environment of the affected individual. A dynamic Bayesian network to predict eye xations, which infers probability allocations over attended objects and spatial locations directly from observed data, is introduced in [40].
The effect of face masks on the stereotype effect in emotion perception
2022, Journal of Experimental Social PsychologyCitation Excerpt :Notably, we found evidence for both hypotheses, and thus successfully replicated prior studies (Bijlstra et al., 2010, 2014). Secondly, we compared predictions derived from predictive coding accounts (Otten et al., 2017) with predictions derived from Study 1 and found evidence for neither. In the current studies, we replicated existing research showing stereotype effects in emotion perception (Bijlstra et al., 2010, 2014).
Reconsidering autistic ‘camouflaging’ as transactional impression management
2022, Trends in Cognitive Sciences