Audiovisual integration of letters in the human brain

Neuron. 2000 Nov;28(2):617-25. doi: 10.1016/s0896-6273(00)00138-0.

Abstract

Letters of the alphabet have auditory (phonemic) and visual (graphemic) qualities. To investigate the neural representations of such audiovisual objects, we recorded neuromagnetic cortical responses to auditorily, visually, and audiovisually presented single letters. The auditory and visual brain activations first converged around 225 ms after stimulus onset and then interacted predominantly in the right temporo-occipito-parietal junction (280345 ms) and the left (380-540 ms) and right (450-535 ms) superior temporal sulci. These multisensory brain areas, playing a role in audiovisual integration of phonemes and graphemes, participate in the neural network supporting the supramodal concept of a "letter." The dynamics of these functions bring new insight into the interplay between sensory and association cortices during object recognition.

Publication types

  • Clinical Trial
  • Research Support, Non-U.S. Gov't

MeSH terms

  • Acoustic Stimulation
  • Adult
  • Auditory Pathways / physiology
  • Brain / physiology*
  • Brain Mapping
  • Female
  • Humans
  • Magnetoencephalography
  • Male
  • Nerve Net / physiology
  • Occipital Lobe / physiology
  • Parietal Lobe / physiology
  • Pattern Recognition, Visual / physiology*
  • Photic Stimulation
  • Reaction Time / physiology
  • Reading*
  • Speech Perception / physiology*
  • Temporal Lobe / physiology
  • Visual Pathways / physiology