User profiles for Marten van Schijndel

Marten van Schijndel

Cornell University
Verified email at cornell.edu
Cited by 1120

Quantity doesn't buy quality syntax with neural language models

M Van Schijndel, A Mueller, T Linzen - arXiv preprint arXiv:1909.00111, 2019 - arxiv.org
Recurrent neural networks can learn to predict upcoming words remarkably well on average;
in syntactically complex contexts, however, they often assign unexpectedly high …

Single‐stage prediction models do not explain the magnitude of syntactic disambiguation difficulty

M Van Schijndel, T Linzen - Cognitive science, 2021 - Wiley Online Library
The disambiguation of a syntactically ambiguous sentence in favor of a less preferred parse
can lead to slower reading at the disambiguation point. This phenomenon, referred to as a …

[PDF][PDF] Modeling garden path effects without explicit hierarchical syntax.

M Van Schijndel, T Linzen - CogSci, 2018 - vansky.github.io
The disambiguation of syntactically ambiguous sentences can lead to reading difficulty, often
referred to as a garden path effect. The surprisal hypothesis suggests that this difficulty can …

A model of language processing as hierarchic sequential prediction

M van Schijndel, A Exley… - Topics in cognitive …, 2013 - Wiley Online Library
Computational models of memory are often expressed as hierarchic sequence models, but
the hierarchies in these models are typically fairly shallow, reflecting the tendency for …

fMRI reveals language-specific predictive coding during naturalistic sentence comprehension

C Shain, IA Blank, M van Schijndel, W Schuler… - Neuropsychologia, 2020 - Elsevier
Much research in cognitive neuroscience supports prediction as a canonical computation of
cognition across domains. Is such predictive coding implemented by feedback from higher-…

All bark and no bite: Rogue dimensions in transformer language models obscure representational quality

W Timkey, M Van Schijndel - arXiv preprint arXiv:2109.04404, 2021 - arxiv.org
Similarity measures are a vital tool for understanding how language models represent and
process language. Standard representational similarity measures such as cosine similarity …

A neural model of adaptation in reading

M Van Schijndel, T Linzen - arXiv preprint arXiv:1808.09930, 2018 - arxiv.org
It has been argued that humans rapidly adapt their lexical and syntactic expectations to
match the statistics of the current linguistic context. We provide further support to this claim by …

[HTML][HTML] Salience and attention in surprisal-based accounts of language processing

A Zarcone, M Van Schijndel, J Vogels… - Frontiers in …, 2016 - frontiersin.org
The notion of salience has been singled out as the explanatory factor for a diverse range of
linguistic phenomena. In particular, perceptual salience (eg, visual salience of objects in the …

Using priming to uncover the organization of syntactic representations in neural language models

G Prasad, M Van Schijndel, T Linzen - arXiv preprint arXiv:1909.10579, 2019 - arxiv.org
Neural language models (LMs) perform well on tasks that require sensitivity to syntactic
structure. Drawing on the syntactic priming paradigm from psycholinguistics, we propose a novel …

Memory access during incremental sentence processing causes reading time latency

C Shain, M Van Schijndel, R Futrell… - Proceedings of the …, 2016 - aclanthology.org
Studies on the role of memory as a predictor of reading time latencies (1) differ in their predictions
about when memory effects should occur in processing and (2) have had mixed results…