Skip to main content
bioRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search
New Results

A Spatiotemporal Map of Reading Aloud

View ORCID ProfileOscar Woolnough, View ORCID ProfileCristian Donos, View ORCID ProfileAidan Curtis, View ORCID ProfilePatrick S. Rollo, Zachary J. Roccaforte, View ORCID ProfileStanislas Dehaene, View ORCID ProfileSimon Fischer-Baum, View ORCID ProfileNitin Tandon
doi: https://doi.org/10.1101/2021.05.23.445307
Oscar Woolnough
1Vivian L. Smith Department of Neurosurgery, McGovern Medical School at UT Health Houston, Houston, TX, 77030, United States of America
2Texas Institute for Restorative Neurotechnologies, University of Texas Health Science Center at Houston, Houston, TX, 77030, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Oscar Woolnough
Cristian Donos
1Vivian L. Smith Department of Neurosurgery, McGovern Medical School at UT Health Houston, Houston, TX, 77030, United States of America
3Faculty of Physics, University of Bucharest, 050663, Bucharest, Romania
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Cristian Donos
Aidan Curtis
1Vivian L. Smith Department of Neurosurgery, McGovern Medical School at UT Health Houston, Houston, TX, 77030, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Aidan Curtis
Patrick S. Rollo
1Vivian L. Smith Department of Neurosurgery, McGovern Medical School at UT Health Houston, Houston, TX, 77030, United States of America
2Texas Institute for Restorative Neurotechnologies, University of Texas Health Science Center at Houston, Houston, TX, 77030, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Patrick S. Rollo
Zachary J. Roccaforte
1Vivian L. Smith Department of Neurosurgery, McGovern Medical School at UT Health Houston, Houston, TX, 77030, United States of America
2Texas Institute for Restorative Neurotechnologies, University of Texas Health Science Center at Houston, Houston, TX, 77030, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Stanislas Dehaene
4Cognitive Neuroimaging Unit CEA, INSERM, NeuroSpin Center, Université Paris-Sud and Université Paris-Saclay, 91191, Gif-sur-Yvette, France
5Collège de France, 11 Place Marcelin Berthelot, 75005, Paris, France
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Stanislas Dehaene
Simon Fischer-Baum
6Department of Psychological Sciences, Rice University, Houston, TX, 77005, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Simon Fischer-Baum
Nitin Tandon
1Vivian L. Smith Department of Neurosurgery, McGovern Medical School at UT Health Houston, Houston, TX, 77030, United States of America
2Texas Institute for Restorative Neurotechnologies, University of Texas Health Science Center at Houston, Houston, TX, 77030, United States of America
7Memorial Hermann Hospital, Texas Medical Center, Houston, TX, 77030, United States of America
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Nitin Tandon
  • For correspondence: nitin.tandon@uth.tmc.edu
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Supplementary material
  • Preview PDF
Loading

Abstract

Reading words aloud is a foundational aspect of the acquisition of literacy. The rapid rate at which multiple distributed neural substrates are engaged in this process can only be probed via techniques with high spatiotemporal resolution. We used direct intracranial recordings in a large cohort to create a holistic yet fine-grained map of word processing, enabling us to derive the spatiotemporal neural codes of multiple word attributes critical to reading: lexicality, word frequency and orthographic neighborhood. We found that lexicality is encoded by early activity in mid-fusiform (mFus) cortex and precentral sulcus. Word frequency is also first represented in mFus followed by later engagement of the inferior frontal gyrus (IFG) and inferior parietal sulcus (IPS), and orthographic neighborhood is encoded solely in the IPS. A lexicality decoder revealed high weightings for electrodes in the mFus, IPS, anterior IFG and the pre-central sulcus. These results elaborate the neural codes underpinning extant dual-route models of reading, with parallel processing via the lexical route, progressing from mFus to IFG, and the sub-lexical route, progressing from IPS to anterior IFG.

Introduction

Reading a word aloud requires multiple complex transformations in the brain - mapping the visual input of a letter string into an internal sequence of sound representations that are then expressed through orofacial motor articulations. Models of how this mapping occurs during reading invoke a dual-route architecture (Coltheart et al., 2001; Perry et al., 2007, 2010, 2019; Taylor et al., 2013), with a lexico-semantic route for rapidly reading known words and a sub-lexical route for constructing the phonology of novel words. A common method of targeting these two routes is to look at contrasts between phonological exception words and pseudowords (Fiebach et al., 2002; Sebastian et al., 2014; Shim et al., 2012; Taylor et al., 2013). Exception words contain irregular grapheme-phoneme associations (e.g. yacht, sew) and their phonologies must be retrieved from internal lexical representations as they cannot be accurately constructed de novo. In contrast, pseudowords have no stored representation and their phonology must be constructed rather than retrieved.

Ventral temporal cortex, particularly mid-fusiform cortex (mFus), is strongly associated with the lexical route. mFus is heavily implicated as the site of the orthographic lexicon, the long-term memory storage of which letter strings map onto known words (Glezer et al., 2015; Hirshorn et al., 2016; Kronbichler et al., 2004; Lochy et al., 2018; White et al., 2019; Woolnough et al., 2021). This region is sensitive to lexicality and word frequency (Kronbichler et al., 2004; White et al., 2019; Woolnough et al., 2021), and shows selective changes during visual word learning (Glezer et al., 2015; Taylor et al., 2019). The sub-lexical route, essential for articulating novel words, is thought to engage the inferior parietal lobe (IPL), dysfunction of which is associated with dyslexia (Raschle et al., 2011; Temple et al., 2003; Tomasino et al., 2020), dysgraphia (Rapp et al., 2016), in addition to phonological and semantic deficits (Binder et al., 2009; Hula et al., 2020; Numssen et al., 2021). The two routes are proposed to converge in the inferior frontal gyrus (IFG) (Taylor et al., 2013).

The majority of our knowledge regarding the neural architecture underlying reading aloud is derived from lesion data and functional MRI which provide accurate spatial localizations of function but lack crucial temporal information. We utilized intracranial recordings in a large cohort of patients (44 patients, 3,642 electrodes), with medically intractable epilepsy, while they read aloud known and novel words. This allowed us to comprehensively map the flow of information through these cortical networks and track the spatiotemporal dynamics of the cortical representation of behaviorally relevant lexical and sub-lexical factors.

Results

Participants were visually presented with phonologically regular words, exception words and novel pseudowords that they read aloud (Figure 1A). Electrophysiological recordings were performed from a total of 3,642 separate intracranial electrodes placed for the localization of intractable epilepsy (Figure 1B,C) - 4 participants had subdural grid electrodes (SDEs) and 40 had depth recordings using stereotactic EEG electrodes (sEEGs).

Figure 1:
  • Download figure
  • Open in new tab
Figure 1: Experimental Design and Electrode Coverage.

(A) Schematic representation of the reading task. (B) Representative coverage map (44 patients) and (C) individual electrode locations (3,642 electrodes) for the left hemisphere, highlighting responsive electrodes (1,158 electrodes; >20% activation above baseline).

Behavioral Analysis

Mean (± SD) response times (RTs) were: regular words (743 ± 122 ms), exception words (747 ± 125 ms) and pseudowords (923 ± 193 ms) (Figure 2A). Regular and exception words showed no difference in RT (Wilcoxon sign rank, p = 0.75; ln(Bayes Factor (BF10)) = −1.5) though pseudoword RT was slower than for exception words (p < 10−8, ln(BF10) = 28).

Figure 2:
  • Download figure
  • Open in new tab
Figure 2: Population Word Response Times.

(A) Response time distribution for each of the three word classes, averaged within participant, (B) Mean (± SE) response times for each item within the three word classes, averaged across participants.

To determine the underlying properties of the words that modulate RT within this cohort, we performed linear mixed effects (LME) and Bayes factor (BF) analyses on each word class with fixed effects modelling linguistic factors commonly linked to word identification and articulation (Table 1). Regular words and exception word RTs showed the greatest modulation by word frequency. Pseudoword RT was most strongly associated with orthographic neighborhood.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Table 1: Statistical Modelling of Response Time.

As predictors were normalized, β values approximate change in RT between extreme values within the entire stimulus set (Supplementary Table 1). Factors with strong evidence of an effect (ln(BF10) > 2.3) are highlighted.

Spatiotemporal Mapping of Single Word Reading

We used a mixed-effects, multilevel analysis (MEMA) of broadband gamma activity (BGA; 70-150 Hz) in group surface normalized space to create a population level map of cortical activation across the population. This analysis is specifically designed to account for sampling variations and to minimize effects of outliers (Argall et al., 2006; Conner et al., 2014; Esposito et al., 2013; Fischl et al., 1999; Kadipasaoglu et al., 2014; Saad and Reynolds, 2012). All correctly articulated trials across all word classes, were used. 4D representations of the spread of activation across the cortical surface were generated by performing MEMA on short, overlapping time windows (150 ms width, 10 ms spacing) to generate successive images of cortical activity, time locked to stimulus onset (Video 1) or the onset of articulation (Video 2). The spatial distribution of activations was highly comparable across word classes (Supplementary Figure 1).

By collapsing across these frames, we visualized peak activations at each point on the cortical surface (Figure 3A). To create a more focused visualization of the spatiotemporal progression across reading-sensitive cortex, we selected 12 regions of interest (ROIs) in areas thought to be important to written word processing, speech production and speech monitoring (Figure 3B,C). This analysis highlights regions displaying primarily pre-articulatory processes, in ventral occipitotemporal cortex, inferior parietal lobe and the inferior frontal gyrus.

Figure 3:
  • Download figure
  • Open in new tab
Figure 3: Spatiotemporal Profile of Cortical Activations.

(A) Collapsed articulation-locked activation movie (Video 2) highlighting the amplitude of peak activation. (B) Representative ROIs in 12 anatomically and functionally distinct regions, showing all responsive electrodes. (C) Mean activation during word reading of each ROI, averaged within patient, time locked to stimulus onset (left) and articulation onset (right). Standard errors omitted for visual clarity. LOT, Lateral OccipitoTemporal cortex; mFus, mid-Fusiform Cortex; IPS, Inferior Parietal Sulcus; pCS, pre-Central Sulcus; pIFG, posterior Inferior Frontal Gyrus; aIFG, anterior Inferior Frontal Gyrus; FO, Frontal Operculum; iMC, inferior Motor Cortex; SMG, Supra Marginal Gyrus; SMA, Supplementary Motor Area; PI, Posterior Insula; STG, Superior Temporal Gyrus.

Spatiotemporal Representation of Lexical Factors

To distinguish activity patterns across word classes we contrasted grouped gamma power activations between exception vs. pseudowords (lexicality) and exception vs. regular words (regularity) using MEMA. The lexicality contrasts demonstrated clusters in mFus, precentral sulcus (pCS), inferior parietal sulcus (IPS) and anterior inferior frontal gyrus (aIFG).

To determine how distinguishable whole-network activity patterns are for each of these factors, within-individuals at a single trial level, we used a logistic regression decoder. Decoders trained to distinguish between exception word and pseudoword trials demonstrated high decoding accuracy, with some patients showing >80% decoding accuracy (Figure 4C). These lexicality decoders displayed high electrode weightings across the ventral temporal surface, IPS, pCS and aIFG (Figure 4D). Decoders trained to distinguish exception and regular words did not show higher decoding accuracy than in the baseline period.

Figure 4:
  • Download figure
  • Open in new tab
Figure 4: Contrasting Word Classes.

(A,B) MEMA contrasts of (A) exception – pseudoword and (B) exception – regular, revealing regions of significantly different BGA between conditions (p < 0.01 corrected). Regions in black did not have consistent coverage for reliable MEMA results. (C) Decoding accuracies of the logistic regression decoders trained to distinguish exception word vs. pseudoword trials (left) and exception word vs regular word trials (right). Grey lines represent individual patient decoding accuracies. Colored line represents median accuracy. (D) Cortical surface representation of population average electrode weightings of the exception vs pseudoword decoder between 300 – 500 ms.

We observed lexicality distinctions between known words (regular and exception) and novel pseudowords broadly across the previously defined ROIs (Figure 5). These distinctions were observed earliest in mFus before spreading to pCS and visual word form regions, and subsequently to IFG and IPS. Distinctions were also observed in post-articulatory auditory regions (posterior insula and superior temporal gyrus) relating to differences in RT between known and novel words.

Figure 5:
  • Download figure
  • Open in new tab
Figure 5: Spatiotemporal Activation Profiles of Known and Novel Words.

Mean activation (± SE) for each word class, within each ROI, during word reading, averaged within patient, time locked to stimulus onset. Number of electrodes and patients, per ROI, is indicated. LOT, Lateral OccipitoTemporal cortex; mFus, mid-Fusiform Cortex; IPS, Inferior Parietal Sulcus; pCS, pre-Central Sulcus; pIFG, posterior Inferior Frontal Gyrus; aIFG, anterior Inferior Frontal Gyrus; FO, Frontal Operculum; iMC, inferior Motor Cortex; SMG, Supra Marginal Gyrus; SMA, Supplementary Motor Area; PI, Posterior Insula; STG, Superior Temporal Gyrus.

For the six ROIs that showed a clear pre-articulatory peak in activation, we analyzed their activity for sensitivity to the main drivers of RT seen in the behavioral analysis; lexicality, word frequency of known words and orthographic neighborhood of pseudowords. mFus showed the earliest sensitivity to lexicality, followed by LOT and pCS, and then broad sensitivity across multiple regions (Figure 6A). mFus showed an early and long-lasting word frequency sensitivity, with IPS and aIFG becoming sensitive later (500-700 ms). Sensitivity to orthographic neighborhood of pseudowords was only seen in IPS (500-700 ms).

Figure 6:
  • Download figure
  • Open in new tab
Figure 6: Regression of Lexical Factors.

(A) Bayes factor analysis of lexicality, word frequency and orthographic neighborhood effects in the six pre-articulatory ROIs, for three time windows. Lexicality tested all known words against pseudowords. Word frequency was regressed across all known words. Orthographic neighborhood was regressed across all pseudowords. Bayes factor (ln(BF10)) shown for each contrast and values >2.3 are highlighted. (B,C) Linear mixed effects (LME) model regression of (B) word frequency in known words and (C) orthographic neighborhood in pseudowords, in three ROIs (β ± SE; mFus, 49 electrodes, 19 patients; IPS, 21 electrodes, 9 patients; aIFG, 35 electrodes, 9 patients). Colored bars represent regions of significance (q < 0.05).

For the three regions we found to have evidence of word frequency or orthographic neighborhood sensitivity, mFus, IPS and aIFG, we used LME models at a higher time resolution. Sensitivity to word frequency was observed earliest in mFus (200 ms) followed by IPS and aIFG (425 ms) (Figure 6B). In IPS we observed a period of elevated orthographic neighborhood sensitivity, but this did not show significance at this time resolution (Figure 6C).

Discussion

This large population intracranial study comprehensively maps the spatiotemporal spread of cortical activation across the left hemisphere during word reading to derive the dynamics of cortical networks underlying literacy. Dual-route architectures of reading networks (Coltheart et al., 2001; Perry et al., 2007, 2010, 2019), derived on behavioral and lesional data, imply separable processing routes for known vs novel words. We find a network of regions sensitive to lexicality, initially the mFus and pCS, then spreading broadly across IPS and IFG. The spatial distribution of this lexicality effect is broadly comparable with the lexicality network identified with fMRI (Heim et al., 2013; Taylor et al., 2013, 2014), with the added benefit of millisecond temporal resolution. Responses in lexicality sensitive regions maximally separate for known and novel words between 300-500ms after stimulus onset, in a manner that is reliable enough to enable single trial decoding of lexicality. These data minimize the impact of response time variations, which confounds modalities with lower temporal resolution (e.g. fMRI) and may artificially inflate lexicality effects in regions such as IFG (Taylor et al., 2014).

We have previously demonstrated that mFus is the earliest region in ventral temporal cortex to show sensitivity to word frequency while reading (Woolnough et al., 2021). It is commonly assumed that sensitivity to statistical properties of language such as word frequency seen in ventral temporal cortex are as a result of top-down modulation from IFG (Heim et al., 2013; Price and Devlin, 2011; Woodhead et al., 2014). Here, we demonstrate again the primacy of the mFus in coding both word frequency and lexicality, preceding the engagement of aIFG and IPS in these processes by over 200 ms. This consolidates mFus’s role as a specialized orthographic lexicon, organized based on statistical regularities of individual words in natural language.

The IPS was the only region with sensitivity to orthographic neighborhood. This sensitivity likely reflects grapheme-phoneme conversion processes in this region (Dehaene-Lambertz et al., 2018; Xu et al., 2020). Given that IPS shows both word frequency and lexicality sensitivity, its role in sub-lexical processing might appear to be questionable. However, for known words, the lexical route is faster and more accurate than the sub-lexical route – thus, once a letter string is identified as a known lexical object, sub-lexical processes are no longer required. Given the word frequency dependence of lexical identification, the timing of the cessation of sub-lexical processes should also be frequency dependent. This interpretation is entirely consistent with our data as IPS shows more sustained activity, but not higher peak activity for novel words.

It is theorized that pCS is involved in articulatory phonological processing, specifically feedforward control of articulator velocity (Matchin and Hickok, 2020; Tourville and Guenther, 2011). Through lesion studies pCS has also been linked to phonological dyslexia (Rapcsak et al., 2009; Tomasino et al., 2020). Our data demonstrate that pCS activation begins early, preceding the IFG, suggesting a role in early linguistic or phonological processing, potentially as part of the sub-lexical route. pCS demonstrates lexical sensitivity but no effect of word frequency. Given the association of pCS with articulation phonology and phonological dyslexia, this may represent part of the process of constructing novel phonologies.

This study provides further evidence that medial frontal operculum is involved in pre-articulatory, preparatory processes, distinct from those of the lateral IFG (Mălîia et al., 2018; Woolnough et al., 2019). Lesions involving this region have been linked to impairment of complex articulation (Baldo et al., 2011) which may explain the greater engagement during pseudoword articulation.

We observed no significant pre-articulatory activity in middle temporal gyrus or angular gyrus, regions that have been linked to semantic and phonological processes during word processing (Graves et al., 2010; Hartwigsen et al., 2010; Sliwinska et al., 2015; Stoeckel et al., 2009). These regions appear to be engaged during reading in children but may not be recruited in adults for simple reading tasks (Martin et al., 2015), instead being used primarily for comprehending multi-word phrases (Dronkers et al., 2004; Fridriksson et al., 2018; Matchin et al., 2017).

Materials and Methods

Participants

44 patients (25 male, 19-60 years, 5 left-handed, IQ 94 ± 15, Age of Epilepsy Onset 18 ± 9 years) participated in the experiments after giving written informed consent. All participants were semi-chronically implanted with intracranial electrodes for seizure localization of pharmaco-resistant epilepsy. Participants were excluded if they had confirmed right-hemisphere language dominance or a significant additional neurological history (e.g. previous resections, MR imaging abnormalities such as malformations or hypoplasia). All experimental procedures were reviewed and approved by the Committee for the Protection of Human Subjects (CPHS) of the University of Texas Health Science Center at Houston as Protocol Number HSC-MS-06-0385.

Electrode Implantation and Data Recording

Data were acquired from either subdural grid electrodes (SDEs; 4 patients) or stereotactically placed depth electrodes (sEEGs; 40 patients). SDEs were subdural platinum-iridium electrodes embedded in a silicone elastomer sheet (PMT Corporation; top-hat design; 3mm diameter cortical contact), and were surgically implanted via a craniotomy (Pieters et al., 2013; Tandon, 2012; Tong et al., 2020). sEEGs were implanted using a Robotic Surgical Assistant (ROSA; Medtech, Montpellier, France) (Rollo et al., 2020; Tandon et al., 2019). Each sEEG probe (PMT corporation, Chanhassen, Minnesota) was 0.8 mm in diameter and had 8-16 electrode contacts. Each contact was a platinum-iridium cylinder, 2.0 mm in length and separated from the adjacent contact by 1.5 - 2.43 mm. Each patient had 12-20 such probes implanted. Following surgical implantation, electrodes were localized by co-registration of pre-operative anatomical 3T MRI and post-operative CT scans in AFNI (Cox, 1996). Electrode positions were projected onto a cortical surface model generated in FreeSurfer (Dale et al., 1999), and displayed on the cortical surface model for visualization (Pieters et al., 2013). Intracranial data were collected during research experiments starting on the first day after electrode implantation for sEEGs and two days after implantation for SDEs. Data were digitized at 2 kHz using the NeuroPort recording system (Blackrock Microsystems, Salt Lake City, Utah), imported into Matlab, initially referenced to the white matter channel used as a reference for the clinical acquisition system and visually inspected for line noise, artifacts and epileptic activity. Electrodes with excessive line noise or localized to sites of seizure onset were excluded. Each electrode was re-referenced to the common average of the remaining channels. Trials contaminated by inter-ictal epileptic spikes were discarded.

Stimuli and Experimental Design

All patients undertook a word reading task. Stimuli were presented on a 2,880 × 1,800 pixel, 15.4” LCD screen positioned at eye-level, 2-3’ from the patient. Participants were presented with 80 each of monosyllabic (i) phonologically regular words, (ii) phonologically irregular exception words and (iii) novel pseudowords and asked to read them aloud. Stimuli were presented using Psychophysics Toolbox (Kleiner et al., 2007) in Matlab, in all lower-case letters, in Arial font with a height of 150 pixels (~2.2° visual angle). Each stimulus was displayed for 1,500 ms with an inter-stimulus interval of 2,000 ms. Stimuli were presented in two recording sessions, each containing presentation of 120 stimuli in a pseudorandom order with no repeats. 95 ± 4% of trials were correctly articulated. The most common errors were regularization of exception words (e.g. sew as sue, soot as sute) or lexicalization of pseudowords (e.g. shret as shirt, jinje as jingle).

Signal Analysis

Analyses were performed by first bandpass filtering raw data of each electrode into broadband gamma activity (BGA; 70-150Hz) following removal of line noise (zero-phase 2nd order Butterworth bandstop filters). A frequency domain bandpass Hilbert transform (paired sigmoid flanks with half-width 1.5 Hz) was applied and the analytic amplitude was smoothed (Savitzky - Golay finite impulse response, 3rd order, frame length of 201 ms). BGA is presented here as percentage change from baseline level, defined as the period −500 to −100 ms before each word presentation.

Electrodes were tested to see if they were responsive during the task. Responsiveness was defined as displaying >20% average BGA over baseline for at least one of the three following windows: 100 to 500 ms following stimulus onset, −500 to −100 ms before articulation onset or 100 to 500 ms following articulation onset. Of the 3,642 useable electrodes, 1,158 electrodes were designated responsive based on these criteria.

Neural Decoding

Decoding analyses were performed using logistic regression classifiers, using 5-fold cross validation, implemented within MNE-Python (Gramfort, 2013; Gramfort et al., 2014). For each patient, decoding performance was summarized with an area under the curve (AUC) and a set of classifier weights for each electrode. Temporal decoding was performed on BGA using a sliding estimator at each time point, using all available electrodes. Spatial distribution of classifier weights was reconstructed by a cortical surface transform onto a standardized brain surface using each electrode’s presumed “recording zone”, an exponentially decaying geodesic radius (Kadipasaoglu et al., 2014). Cortical surface maps were amplitude normalized within patient then averaged across patient to create a population weighting map.

Linguistic Analysis

We quantified word frequency as the base-10 log of the SUBTLEXus frequency (Brysbaert and New, 2009). This resulted in a frequency of 1 meaning 10 instances per million words and 4 meaning 10,000 instances per million words. There was no significant difference between word frequency of regular (1.5 ± 0.35; Mean ± SD) and exception (1.7 ± 1.0) words (Wilcoxon rank sum, p = 0.36). Positional letter frequency was calculated as the base-10 log of the sum of the SUBTLEXus frequencies of all words with a given letter in a specific ordinal position. Orthographic neighborhood was quantified as the orthographic Levenshtein distance (OLD20); the mean number of single character edits required to convert the word into its 20 nearest neighbors with a log frequency greater than 0 (Yarkoni et al., 2008). Phonological neighborhood densities were obtained from the Irvine Phonotactic Online Dictionary (IPhOD) (Vaden et al., 2009). Pseudowords were phonemically transcribed using the most common pronunciation.

Author Contributions

Conceptualization: OW, CD, SD, NT; Methodology: OW, CD, NT; Data curation: OW, CD, PSR, ZR; Software: OW, CD, AC; Formal Analysis: OW, AC; Writing – Original Draft: OW; Writing – Review and Editing: OW, SD, SFB, NT; Visualization: OW; Funding Acquisition: NT; Neurosurgical Procedures: NT.

Declaration of Interests

The authors declare no competing interests

Supplementary Information

Video 1: Spread of Stimulus-Locked Activity across the Cortical Surface. MEMA movie of the time course of broadband gamma activation across the cortical surface with trials time-locked to onset of the visual stimulus. Regions in black did not have consistent coverage for reliable MEMA results.

Video 2: Spread of Articulation-Locked Activity across the Cortical Surface. MEMA movie of the time course of broadband gamma activation across the cortical surface with trials time locked to the onset of articulation. Regions in black did not have consistent coverage for reliable MEMA results.

View this table:
  • View inline
  • View popup
  • Download powerpoint
Supplementary Table 1: Distribution of Statistical Regressors.

Minimum, median and maximum values for each of the regressors used, across the whole stimulus set and for individual word classes. Statistical models used normalized data, subtracting the minimum value and dividing by the range across the whole stimulus set.

Supplementary Figure 1:
  • Download figure
  • Open in new tab
Supplementary Figure 1: Conjunction Map of Word Class Activations.

MEMA conjunction maps showing overlap of binarized activation maps of each of the three word classes tested (%BGA > 5%, t > 2.58, patients ≥ 3), over three time windows locked to stimulus onset. Across all time windows all three word classes demonstrate a gross overlap of activation (white). In the later time window, areas associated with post-articulatory processes (e.g. auditory cortex) show selective activation for known words, reflecting differences in response time between known words and novel pseudowords. Regions in black did not have consistent coverage for reliable MEMA results.

Acknowledgements

We express our gratitude to all the patients who participated in this study; the neurologists at the Texas Comprehensive Epilepsy Program who participated in the care of these patients; and the nurses and technicians in the Epilepsy Monitoring Unit at Memorial Hermann Hospital who helped make this research possible. This work was supported by the National Institute of Neurological Disorders and Stroke NS098981.

References

  1. ↵
    Argall, B.D., Saad, Z.S., and Beauchamp, M.S. (2006). Simplified intersubject averaging on the cortical surface using SUMA. Hum. Brain Mapp. 27, 14–27.
    OpenUrlCrossRefPubMedWeb of Science
  2. ↵
    Baldo, J. V, Wilkins, D.P., Ogar, J., Willock, S., and Dronkers, N.F. (2011). Role of the precentral gyrus of the insula in complex articulation. Cortex 47, 800–807.
    OpenUrlCrossRefPubMedWeb of Science
  3. ↵
    Binder, J.R., Desai, R.H., Graves, W.W., and Conant, L.L. (2009). Where is the semantic system? A critical review and meta-analysis of 120 functional neuroimaging studies. Cereb. Cortex 19, 2767–2796.
    OpenUrlCrossRefPubMedWeb of Science
  4. ↵
    Brysbaert, M., and New, B. (2009). Moving beyond Kučera and Francis: A critical evaluation of current word frequency norms and the introduction of a new and improved word frequency measure for American English. Behav. Res. Methods 41, 977–990.
    OpenUrlCrossRefPubMedWeb of Science
  5. ↵
    Coltheart, M., Rastle, K., Perry, C., Langdon, R., and Ziegler, J. (2001). DRC: A dual route cascaded model of visual word recognition and reading aloud. Psychol. Rev. 108, 204–256.
    OpenUrlCrossRefPubMedWeb of Science
  6. ↵
    Conner, C.R., Chen, G., Pieters, T.A., and Tandon, N. (2014). Category specific spatial dissociations of parallel processes underlying visual naming. Cereb. Cortex 24, 2741–2750.
    OpenUrlCrossRefPubMed
  7. ↵
    Cox, R.W. (1996). AFNI: Software for Analysis and Visualization of Functional Magnetic Resonance Neuroimages. Comput. Biomed. Res. 29, 162–173.
    OpenUrlCrossRefPubMedWeb of Science
  8. ↵
    Dale, A.M., Fischl, B., and Sereno, M.I. (1999). Cortical Surface-Based Analysis: I. Segmentation and Surface Reconstruction. Neuroimage 9, 179–194.
    OpenUrlCrossRefPubMedWeb of Science
  9. ↵
    Dehaene-Lambertz, G., Monzalvo, K., and Dehaene, S. (2018). The emergence of the visual word form: Longitudinal evolution of category-specific ventral visual areas during reading acquisition. PLOS Biol. 16, e2004103.
    OpenUrlCrossRefPubMed
  10. ↵
    Dronkers, N.F., Wilkins, D.P., Van Valin, R.D., Redfern, B.B., and Jaeger, J.J. (2004). Lesion analysis of the brain areas involved in language comprehension. Cognition 92, 145–177.
    OpenUrlCrossRefPubMedWeb of Science
  11. ↵
    Esposito, F., Singer, N., Podlipsky, I., Fried, I., Hendler, T., and Goebel, R. (2013). Cortex-based inter-subject analysis of iEEG and fMRI data sets: Application to sustained task-related BOLD and gamma responses. Neuroimage 66, 457–468.
    OpenUrlCrossRefPubMed
  12. ↵
    Fiebach, C.J., Friederici, A.D., Müller, K., and Von Cramon, D.Y. (2002). fMRI evidence for dual routes to the mental lexicon in visual word recognition. J. Cogn. Neurosci. 14, 11–23.
    OpenUrlCrossRefPubMedWeb of Science
  13. ↵
    Fischl, B., Sereno, M.I., Tootell, R.B.H., and Dale, A. (1999). High-resolution inter-subject averaging and a surface-based coordinate system. Hum. Brain Mapp. 8, 272–284.
    OpenUrlCrossRefPubMedWeb of Science
  14. ↵
    Fridriksson, J., Den Ouden, D.B., Hillis, A.E., Hickok, G., Rorden, C., Basilakos, A., Yourganov, G., and Bonilha, L. (2018). Anatomy of aphasia revisited. Brain 141, 848–862.
    OpenUrlCrossRefPubMed
  15. ↵
    Glezer, L.S., Kim, J., Rule, J., Jiang, X., and Riesenhuber, M. (2015). Adding Words to the Brain’s Visual Dictionary: Novel Word Learning Selectively Sharpens Orthographic Representations in the VWFA. J. Neurosci. 35, 4965–4972.
    OpenUrlAbstract/FREE Full Text
  16. ↵
    Gramfort, A. (2013). MEG and EEG data analysis with MNE-Python. Front. Neurosci. 7, 1–13.
    OpenUrlCrossRefPubMed
  17. ↵
    Gramfort, A., Luessi, M., Larson, E., Engemann, D.A., Strohmeier, D., Brodbeck, C., Parkkonen, L., and Hämäläinen, M.S. (2014). MNE software for processing MEG and EEG data. Neuroimage 86, 446–460.
    OpenUrlCrossRefPubMedWeb of Science
  18. ↵
    Graves, W.W., Desai, R., Humphries, C., Seidenberg, M.S., and Binder, J.R. (2010). Neural systems for reading aloud: A multiparametric approach. Cereb. Cortex 20, 1799–1815.
    OpenUrlCrossRefPubMedWeb of Science
  19. ↵
    Hartwigsen, G., Baumgaertner, A., Price, C.J., Koehnke, M., Ulmer, S., and Siebner, H.R. (2010). Phonological decisions require both the left and right supramarginal gyri. Proc. Natl. Acad. Sci. U. S. A. 107, 16494–16499.
    OpenUrlAbstract/FREE Full Text
  20. ↵
    Heim, S., Wehnelt, A., Grande, M., Huber, W., and Amunts, K. (2013). Effects of lexicality and word frequency on brain activation in dyslexic readers. Brain Lang. 125, 194–202.
    OpenUrlCrossRef
  21. ↵
    Hirshorn, E.A., Li, Y., Ward, M.J., Richardson, R.M., Fiez, J.A., and Ghuman, A.S. (2016). Decoding and disrupting left midfusiform gyrus activity during word reading. Proc. Natl. Acad. Sci. 113, 8162–8167.
    OpenUrlAbstract/FREE Full Text
  22. ↵
    Hula, W.D., Panesar, S., Gravier, M.L., Yeh, F.-C., Dresang, H.C., Dickey, M.W., and Fernandez-Miranda, J.C. (2020). Structural white matter connectometry of word production in aphasia: an observational study. Brain 143, 2532–2544.
    OpenUrl
  23. ↵
    Kadipasaoglu, C.M., Baboyan, V.G., Conner, C.R., Chen, G., Saad, Z.S., and Tandon, N. (2014). Surface-based mixed effects multilevel analysis of grouped human electrocorticography. Neuroimage 101, 215–224.
    OpenUrlCrossRefPubMed
  24. ↵
    Kleiner, M., Brainard, D., and Pelli, D. (2007). What’s new in Psychtoolbox-3? Perception 36.
  25. ↵
    Kronbichler, M., Hutzler, F., Wimmer, H., Mair, A., Staffen, W., and Ladurner, G. (2004). The visual word form area and the frequency with which words are encountered: Evidence from a parametric fMRI study. Neuroimage 21, 946–953.
    OpenUrlCrossRefPubMedWeb of Science
  26. ↵
    Lochy, A., Jacques, C., Maillard, L., Colnat-Coulbois, S., Rossion, B., and Jonas, J. (2018). Selective visual representation of letters and words in the left ventral occipito-temporal cortex with intracerebral recordings. Proc. Natl. Acad. Sci. 115, E7595–E7604.
    OpenUrlAbstract/FREE Full Text
  27. ↵
    Mălîia, M.-D., Donos, C., Barborica, A., Popa, I., Ciurea, J., Cinatti, S., and Mîndru, I. (2018). Functional mapping and effective connectivity of the human operculum. Cortex 109, 303–321.
    OpenUrl
  28. ↵
    Martin, A., Schurz, M., Kronbichler, M., and Richlan, F. (2015). Reading in the brain of children and adults: A meta-analysis of 40 functional magnetic resonance imaging studies. Hum. Brain Mapp. 36, 1963–1981.
    OpenUrlCrossRefPubMed
  29. ↵
    Matchin, W., and Hickok, G. (2020). The Cortical Organization of Syntax. Cereb. Cortex 30, 1481 – 1498.
    OpenUrlCrossRef
  30. ↵
    Matchin, W., Hammerly, C., and Lau, E. (2017). The role of the IFG and pSTS in syntactic prediction: Evidence from a parametric study of hierarchical structure in fMRI. Cortex 88, 106–123.
    OpenUrlCrossRefPubMed
  31. ↵
    Numssen, O., Bzdok, D., and Hartwigsen, G. (2021). Functional specialization within the inferior parietal lobes across cognitive domains. Elife 10.
  32. ↵
    Perry, C., Ziegler, J.C., and Zorzi, M. (2007). Nested incremental modeling in the development of computational theories: The CDP+ model of reading aloud. Psychol. Rev. 114, 273–315.
    OpenUrlCrossRefPubMedWeb of Science
  33. ↵
    Perry, C., Ziegler, J.C., and Zorzi, M. (2010). Beyond single syllables: Large-scale modeling of reading aloud with the Connectionist Dual Process (CDP++) model. Cogn. Psychol. 61, 106–151.
    OpenUrlCrossRefPubMed
  34. ↵
    Perry, C., Zorzi, M., and Ziegler, J.C. (2019). Understanding Dyslexia Through Personalized Large-Scale Computational Models. Psychol. Sci. 30, 386–395.
    OpenUrl
  35. ↵
    Pieters, T.A., Conner, C.R., and Tandon, N. (2013). Recursive grid partitioning on a cortical surface model: an optimized technique for the localization of implanted subdural electrodes. J. Neurosurg. 118, 1086–1097.
    OpenUrlCrossRefPubMed
  36. ↵
    Price, C.J., and Devlin, J.T. (2011). The Interactive Account of ventral occipitotemporal contributions to reading. Trends Cogn. Sci. 15, 246–253.
    OpenUrlCrossRefPubMedWeb of Science
  37. ↵
    Rapcsak, S.Z., Beeson, P.M., Henry, M.L., Leyden, A., Kim, E., Rising, K., Andersen, S., and Cho, H.S. (2009). Phonological dyslexia and dysgraphia: Cognitive mechanisms and neural substrates. Cortex 45, 575–591.
    OpenUrlCrossRefPubMedWeb of Science
  38. ↵
    Rapp, B., Purcell, J., Hillis, A.E., Capasso, R., and Miceli, G. (2016). Neural bases of orthographic long-term memory and working memory in dysgraphia. Brain 139, 588–604.
    OpenUrlCrossRefPubMed
  39. ↵
    Raschle, N.M., Chang, M., and Gaab, N. (2011). Structural brain alterations associated with dyslexia predate reading onset. Neuroimage 57, 742–749.
    OpenUrlCrossRefPubMedWeb of Science
  40. ↵
    Rollo, P.S., Rollo, M.J., Zhu, P., Woolnough, O., and Tandon, N. (2020). Oblique trajectory angles in robotic stereo-electroencephalography. J. Neurosurg.
  41. ↵
    Saad, Z.S., and Reynolds, R.C. (2012). Suma. Neuroimage 62, 768–773.
    OpenUrl
  42. ↵
    Sebastian, R., Gomez, Y., Leigh, R., Davis, C., Newhart, M., and Hillis, A.E. (2014). The roles of occipitotemporal cortex in reading, spelling, and naming. Cogn. Neuropsychol. 31, 511–528.
    OpenUrlCrossRefPubMed
  43. ↵
    Shim, H.S., Hurley, R.S., Rogalski, E., and Mesulam, M.M. (2012). Anatomic, clinical, and neuropsychological correlates of spelling errors in primary progressive aphasia. Neuropsychologia 50, 1929–1935.
    OpenUrl
  44. ↵
    Sliwinska, M.W., James, A., and Devlin, J.T. (2015). Inferior Parietal Lobule Contributions to Visual Word Recognition. J. Cogn. Neurosci. 27, 593–604.
    OpenUrlCrossRefPubMed
  45. ↵
    Stoeckel, C., Gough, P.M., Watkins, K.E., and Devlin, J.T. (2009). Supramarginal gyrus involvement in visual word recognition. Cortex 45, 1091–1096.
    OpenUrlCrossRefPubMedWeb of Science
  46. ↵
    1. D. Yoshor, and
    2. E. Mizrahi
    Tandon, N. (2012). Mapping of human language. In Clinical Brain Mapping, D. Yoshor, and E. Mizrahi, eds. (McGraw Hill Education), pp. 203–218.
  47. ↵
    Tandon, N., Tong, B.A., Friedman, E.R., Johnson, J.A., Von Allmen, G., Thomas, M.S., Hope, O.A., Kalamangalam, G.P., Slater, J.D., and Thompson, S.A. (2019). Analysis of Morbidity and Outcomes Associated With Use of Subdural Grids vs Stereoelectroencephalography in Patients With Intractable Epilepsy. JAMA Neurol. 76, 672–681.
    OpenUrl
  48. ↵
    Taylor, J.S.H., Rastle, K., and Davis, M.H. (2013). Can cognitive models explain brain activation during word and pseudoword reading? A meta-analysis of 36 neuroimaging studies. Psychol. Bull. 139, 766–791.
    OpenUrlCrossRefPubMed
  49. ↵
    Taylor, J.S.H., Rastle, K., and Davis, M.H. (2014). Interpreting response time effects in functional imaging studies. Neuroimage 99, 419–433.
    OpenUrlCrossRefPubMed
  50. ↵
    Taylor, J.S.H., Davis, M.H., and Rastle, K. (2019). Mapping visual symbols onto spoken language along the ventral visual stream. Proc. Natl. Acad. Sci. 116, 17723–17728.
    OpenUrlAbstract/FREE Full Text
  51. ↵
    Temple, E., Deutsch, G.K., Poldrack, R.A., Miller, S.L., Tallal, P., Merzenich, M.M., and Gabrieli, J.D.E. (2003). Neural deficits in children with dyslexia ameliorated by behavioral remediation: Evidence from functional MRI. Proc. Natl. Acad. Sci. U. S. A. 100, 2860–2865.
    OpenUrlAbstract/FREE Full Text
  52. ↵
    Tomasino, B., Ius, T., Skrap, M., and Luzzatti, C. (2020). Phonological and surface dyslexia in individuals with brain tumors: Performance pre-, intra-, immediately post-surgery and at follow-up. Hum. Brain Mapp. 41, 5015–5031.
    OpenUrl
  53. ↵
    Tong, B.A., Esquenazi, Y., Johnson, J., Zhu, P., and Tandon, N. (2020). The Brain is Not Flat: Conformal Electrode Arrays Diminish Complications of Subdural Electrode Implantation, A Series of 117 Cases. World Neurosurg. 144, e734–e742.
    OpenUrl
  54. ↵
    Tourville, J.A., and Guenther, F.H. (2011). The DIVA model: A neural theory of speech acquisition and production. Lang. Cogn. Process. 26, 952–981.
    OpenUrlCrossRefPubMed
  55. ↵
    Vaden, K.I., Halpin, H.R., and Hickok, G.S. (2009). Irvine Phonotactic Online Dictionary, Version 2.0. [Data file].
  56. ↵
    White, A.L., Palmer, J., Boynton, G.M., and Yeatman, J.D. (2019). Parallel spatial channels converge at a bottleneck in anterior word-selective cortex. Proc. Natl. Acad. Sci. 116, 10087–10096.
    OpenUrlAbstract/FREE Full Text
  57. ↵
    Woodhead, Z.V.J., Barnes, G.R., Penny, W., Moran, R., Teki, S., Price, C.J., and Leff, A.P. (2014). Reading front to back: MEG evidence for early feedback effects during word recognition. Cereb. Cortex 24, 817–825.
    OpenUrlCrossRefPubMedWeb of Science
  58. ↵
    Woolnough, O., Forseth, K.J., Rollo, P.S., and Tandon, N. (2019). Uncovering the functional anatomy of the human insula during speech. Elife 8, e53086.
    OpenUrlCrossRef
  59. ↵
    Woolnough, O., Donos, C., Rollo, P.S., Forseth, K.J., Lakretz, Y., Crone, N.E., Fischer-Baum, S., Dehaene, S., and Tandon, N. (2021). Spatiotemporal dynamics of orthographic and lexical processing in the ventral visual pathway. Nat. Hum. Behav. 5, 389–398.
    OpenUrl
  60. ↵
    Xu, W., Kolozsvari, O.B., Oostenveld, R., and Hämäläinen, J.A. (2020). Rapid changes in brain activity during learning of grapheme-phoneme associations in adults. Neuroimage 220, 117058.
    OpenUrl
  61. ↵
    Yarkoni, T., Balota, D., and Yap, M. (2008). Moving beyond Coltheart’s N: A new measure of orthographic similarity. Psychon. Bull. Rev. 15, 971–979.
    OpenUrlCrossRefPubMed
Back to top
PreviousNext
Posted May 23, 2021.
Download PDF

Supplementary Material

Email

Thank you for your interest in spreading the word about bioRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
A Spatiotemporal Map of Reading Aloud
(Your Name) has forwarded a page to you from bioRxiv
(Your Name) thought you would like to see this page from the bioRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
A Spatiotemporal Map of Reading Aloud
Oscar Woolnough, Cristian Donos, Aidan Curtis, Patrick S. Rollo, Zachary J. Roccaforte, Stanislas Dehaene, Simon Fischer-Baum, Nitin Tandon
bioRxiv 2021.05.23.445307; doi: https://doi.org/10.1101/2021.05.23.445307
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
A Spatiotemporal Map of Reading Aloud
Oscar Woolnough, Cristian Donos, Aidan Curtis, Patrick S. Rollo, Zachary J. Roccaforte, Stanislas Dehaene, Simon Fischer-Baum, Nitin Tandon
bioRxiv 2021.05.23.445307; doi: https://doi.org/10.1101/2021.05.23.445307

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Neuroscience
Subject Areas
All Articles
  • Animal Behavior and Cognition (4224)
  • Biochemistry (9101)
  • Bioengineering (6749)
  • Bioinformatics (23933)
  • Biophysics (12082)
  • Cancer Biology (9490)
  • Cell Biology (13727)
  • Clinical Trials (138)
  • Developmental Biology (7614)
  • Ecology (11656)
  • Epidemiology (2066)
  • Evolutionary Biology (15476)
  • Genetics (10615)
  • Genomics (14291)
  • Immunology (9455)
  • Microbiology (22773)
  • Molecular Biology (9069)
  • Neuroscience (48838)
  • Paleontology (354)
  • Pathology (1479)
  • Pharmacology and Toxicology (2561)
  • Physiology (3822)
  • Plant Biology (8307)
  • Scientific Communication and Education (1467)
  • Synthetic Biology (2289)
  • Systems Biology (6168)
  • Zoology (1297)