RT Journal Article
SR Electronic
T1 Visual speech differentially modulates beta, theta, and high gamma bands in auditory cortex
JF bioRxiv
FD Cold Spring Harbor Laboratory
SP 2020.09.07.284455
DO 10.1101/2020.09.07.284455
A1 Ganesan, Karthik
A1 Plass, John
A1 Beltz, Adriene M.
A1 Liu, Zhongming
A1 Grabowecky, Marcia
A1 Suzuki, Satoru
A1 Stacey, William C.
A1 Wasade, Vibhangini S.
A1 Towle, Vernon L.
A1 Tao, James X
A1 Wu, Shasha
A1 Issa, Naoum P
A1 Brang, David
YR 2020
UL http://biorxiv.org/content/early/2020/09/07/2020.09.07.284455.abstract
AB Speech perception is a central component of social communication. While speech perception is primarily driven by sounds, accurate perception in everyday settings is also supported by meaningful information extracted from visual cues (e.g., speech content, timing, and speaker identity). Previous research has shown that visual speech modulates activity in cortical areas subserving auditory speech perception, including the superior temporal gyrus (STG), likely through feedback connections from the multisensory posterior superior temporal sulcus (pSTS). However, it is unknown whether visual modulation of auditory processing in the STG is a unitary phenomenon or, rather, consists of multiple temporally, spatially, or functionally discrete processes. To explore these questions, we examined neural responses to audiovisual speech in electrodes implanted intracranially in the temporal cortex of 21 patients undergoing clinical monitoring for epilepsy. We found that visual speech modulates auditory processes in the STG in multiple ways, eliciting temporally and spatially distinct patterns of activity that differ across theta, beta, and high-gamma frequency bands. Before speech onset, visual information increased high-gamma power in the posterior STG and suppressed beta power in mid-STG regions, suggesting crossmodal prediction of speech signals in these areas. After sound onset, visual speech decreased theta power in the middle and posterior STG, potentially reflecting a decrease in sustained feedforward auditory activity. These results are consistent with models that posit multiple distinct mechanisms supporting audiovisual speech perception.Significance Statement Visual speech cues are often needed to disambiguate distorted speech sounds in the natural environment. However, understanding how the brain encodes and transmits visual information for usage by the auditory system remains a challenge. One persistent question is whether visual signals have a unitary effect on auditory processing or elicit multiple distinct effects throughout auditory cortex. To better understand how vision modulates speech processing, we measured neural activity produced by audiovisual speech from electrodes surgically implanted in auditory areas of 21 patients with epilepsy. Group-level statistics using linear mixed-effects models demonstrated distinct patterns of activity across different locations, timepoints, and frequency bands, suggesting the presence of multiple audiovisual mechanisms supporting speech perception processes in auditory cortex.Competing Interest StatementThe authors have declared no competing interest.