Skip to main content
bioRxiv
  • Home
  • About
  • Submit
  • ALERTS / RSS
Advanced Search
New Results

Semantic representations during language comprehension are affected by context

Fatma Deniz, Christine Tseng, View ORCID ProfileLeila Wehbe, Tom Dupré la Tour, Jack L. Gallant
doi: https://doi.org/10.1101/2021.12.15.472839
Fatma Deniz
aHelen Wills Neuroscience Institute, University of California, Berkeley, CA 94720, USA
bInstitute of Software Engineering and Theoretical Computer Science, Technische Universität Berlin, Berlin, Germany
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Christine Tseng
aHelen Wills Neuroscience Institute, University of California, Berkeley, CA 94720, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Leila Wehbe
cMachine Learning Department, Carnegie Mellon University, Pittsburgh, PA 15213, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • ORCID record for Leila Wehbe
Tom Dupré la Tour
aHelen Wills Neuroscience Institute, University of California, Berkeley, CA 94720, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
Jack L. Gallant
aHelen Wills Neuroscience Institute, University of California, Berkeley, CA 94720, USA
dDepartment of Psychology, University of California, Berkeley, CA 94720, USA
  • Find this author on Google Scholar
  • Find this author on PubMed
  • Search for this author on this site
  • For correspondence: gallant@berkeley.edu
  • Abstract
  • Full Text
  • Info/History
  • Metrics
  • Preview PDF
Loading

Abstract

The meaning of words in natural language depends crucially on context. However, most neuroimaging studies of word meaning use isolated words and isolated sentences with little context. Because the brain may process natural language differently from how it processes simplified stimuli, there is a pressing need to determine whether prior results on word meaning generalize to natural language. fMRI was used to record human brain activity while four subjects (two female) read words in four conditions that vary in context: narratives, isolated sentences, blocks of semantically similar words, and isolated words. We then compared the signal-to-noise ratio (SNR) of evoked brain responses, and we used a voxelwise encoding modeling approach to compare the representation of semantic information across the four conditions. We find four consistent effects of varying context. First, stimuli with more context evoke brain responses with higher SNR across bilateral visual, temporal, parietal, and prefrontal cortices compared to stimuli with little context. Second, increasing context increases the representation of semantic information across bilateral temporal, parietal, and prefrontal cortices at the group level. In individual subjects, only natural language stimuli consistently evoke widespread representation of semantic information. Third, context affects voxel semantic tuning. Finally, models estimated using stimuli with little context do not generalize well to natural language. These results show that context has large effects on the quality of neuroimaging data and on the representation of meaning in the brain. Thus, neuroimaging studies that use stimuli with little context may not generalize well to the natural regime.

Significance Statement Context is an important part of understanding the meaning of natural language, but most neuroimaging studies of meaning use isolated words and isolated sentences with little context. Here we examined whether the results of neuroimaging studies that use out-of-context stimuli generalize to natural language. We find that increasing context improves the quality of neuroimaging data and changes where and how semantic information is represented in the brain. These results suggest that findings from studies using out-of-context stimuli may not generalize to natural language used in daily life.

Competing Interest Statement

The authors have declared no competing interest.

Footnotes

  • New analyses; authors updated.

Copyright 
The copyright holder for this preprint is the author/funder, who has granted bioRxiv a license to display the preprint in perpetuity. All rights reserved. No reuse allowed without permission.
Back to top
PreviousNext
Posted February 22, 2023.
Download PDF
Email

Thank you for your interest in spreading the word about bioRxiv.

NOTE: Your email address is requested solely to identify you as the sender of this article.

Enter multiple addresses on separate lines or separate them with commas.
Semantic representations during language comprehension are affected by context
(Your Name) has forwarded a page to you from bioRxiv
(Your Name) thought you would like to see this page from the bioRxiv website.
CAPTCHA
This question is for testing whether or not you are a human visitor and to prevent automated spam submissions.
Share
Semantic representations during language comprehension are affected by context
Fatma Deniz, Christine Tseng, Leila Wehbe, Tom Dupré la Tour, Jack L. Gallant
bioRxiv 2021.12.15.472839; doi: https://doi.org/10.1101/2021.12.15.472839
Reddit logo Twitter logo Facebook logo LinkedIn logo Mendeley logo
Citation Tools
Semantic representations during language comprehension are affected by context
Fatma Deniz, Christine Tseng, Leila Wehbe, Tom Dupré la Tour, Jack L. Gallant
bioRxiv 2021.12.15.472839; doi: https://doi.org/10.1101/2021.12.15.472839

Citation Manager Formats

  • BibTeX
  • Bookends
  • EasyBib
  • EndNote (tagged)
  • EndNote 8 (xml)
  • Medlars
  • Mendeley
  • Papers
  • RefWorks Tagged
  • Ref Manager
  • RIS
  • Zotero
  • Tweet Widget
  • Facebook Like
  • Google Plus One

Subject Area

  • Neuroscience
Subject Areas
All Articles
  • Animal Behavior and Cognition (4382)
  • Biochemistry (9591)
  • Bioengineering (7091)
  • Bioinformatics (24861)
  • Biophysics (12614)
  • Cancer Biology (9956)
  • Cell Biology (14354)
  • Clinical Trials (138)
  • Developmental Biology (7948)
  • Ecology (12105)
  • Epidemiology (2067)
  • Evolutionary Biology (15988)
  • Genetics (10925)
  • Genomics (14739)
  • Immunology (9869)
  • Microbiology (23667)
  • Molecular Biology (9484)
  • Neuroscience (50865)
  • Paleontology (369)
  • Pathology (1539)
  • Pharmacology and Toxicology (2683)
  • Physiology (4014)
  • Plant Biology (8657)
  • Scientific Communication and Education (1508)
  • Synthetic Biology (2394)
  • Systems Biology (6435)
  • Zoology (1346)