Skip to main content
bioRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search
New Results

Spatio-temporal Characteristics of Noun and Verb Processing during Sentence Comprehension in the Brain

View ORCID ProfileSharmistha Jat, Erika J C Laing, Partha Talukdar, Tom Mitchell
doi: https://doi.org/10.1101/2020.06.22.163808
Sharmistha Jat
1Indian Institute of Science, Bangalore
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Sharmistha Jat
  • For correspondence: sharmistha.jat@gmail.com
Erika J C Laing
2School of Computer Science, Carnegie Mellon University
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Partha Talukdar
1Indian Institute of Science, Bangalore
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Tom Mitchell
2School of Computer Science, Carnegie Mellon University
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Preview PDF
Loading

Abstract

The human brain is very effective at integrating new words one by one into the composed representation of a sentence as it is read left-to-right. This raises the important question of what happens to the neural representations of words present earlier in the sentence? For example, do the strength of word representations encountered earlier on in the sentence remain constant or do they evolve as additional words are processed? Representation of words by neural activity in the brain has been the subject of several previous studies. We perform the experiment with a naturalistic task in which the subjects read simple active and passive sentences. Naturalistic studies have tended to explore words in isolation or in a very limited context (e.g., adjective-noun phrases). Representation of previously encountered words during incremental sentence reading, and how such representation evolve as more parts of a sentence are read, is a fundamental but unexplored problem – we take a first step in this direction. In particular, we examine the spatio-temporal characteristics of neural activity encoding nouns and verbs encountered in a sentence as it is read word-by-word. We use Magnetoencephalography (MEG) to passively observe neural activity, providing 1 ms temporal resolution.

Our experiments reveal that nouns and verbs read early in the sentence have a varying influence on neural activity while reading subsequent words, decreasing and increasing at particular word positions in active and passively voiced sentences, with particularly important contributions to activity in frontal and temporal cortical regions. We find the noun and verb information to be decodable from the neural activity for several seconds after sentence reading has completed. Our exploration is also the first to study the effect of question-answering task on the neural representation of the words post-sentence. We are releasing our 300 sentence MEG dataset to encourage further research in this important area.

Competing Interest Statement

The authors have declared no competing interest.

Footnotes

  • sharmisthaj{at}iisc.ac.in, ppt{at}iisc.ac.in, laing{at}andrew.cmu.edu, tom.mitchell{at}cs.cmu.edu

  • 34th Conference on Neural Information Processing Systems (NeurIPS 2020), Vancouver, Canada.

  • Author names and affiliations are added to the paper header.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. It is made available under a CC-BY-ND 4.0 International license.
Back to top
PreviousNext
Posted June 22, 2020.
Download PDF
Email

Thank you for your interest in spreading the word about bioRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Spatio-temporal Characteristics of Noun and Verb Processing during Sentence Comprehension in the Brain
(Your Name) has forwarded a page to you from bioRxiv
(Your Name) thought you would like to see this page from the bioRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Spatio-temporal Characteristics of Noun and Verb Processing during Sentence Comprehension in the Brain
Sharmistha Jat, Erika J C Laing, Partha Talukdar, Tom Mitchell
bioRxiv 2020.06.22.163808; doi: https://doi.org/10.1101/2020.06.22.163808
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Spatio-temporal Characteristics of Noun and Verb Processing during Sentence Comprehension in the Brain
Sharmistha Jat, Erika J C Laing, Partha Talukdar, Tom Mitchell
bioRxiv 2020.06.22.163808; doi: https://doi.org/10.1101/2020.06.22.163808

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Neuroscience
Subject Areas
All Articles
  • Animal Behavior and Cognition (4842)
  • Biochemistry (10771)
  • Bioengineering (8031)
  • Bioinformatics (27245)
  • Biophysics (13959)
  • Cancer Biology (11108)
  • Cell Biology (16026)
  • Clinical Trials (138)
  • Developmental Biology (8770)
  • Ecology (13265)
  • Epidemiology (2067)
  • Evolutionary Biology (17337)
  • Genetics (11678)
  • Genomics (15902)
  • Immunology (11010)
  • Microbiology (26031)
  • Molecular Biology (10625)
  • Neuroscience (56447)
  • Paleontology (417)
  • Pathology (1729)
  • Pharmacology and Toxicology (2999)
  • Physiology (4539)
  • Plant Biology (9614)
  • Scientific Communication and Education (1612)
  • Synthetic Biology (2682)
  • Systems Biology (6967)
  • Zoology (1508)