Humans exhibit garden path effects: When reading sentences that are
temporarily structurally ambiguous, they slow down when the structure is
disambiguated in favor of the less preferred alternative. Surprisal theory
(Hale, 2001; Levy, 2008), a prominent explanation of this finding, proposes
that these slowdowns are due to the unpredictability of each of the words that
occur in these sentences. Challenging this hypothesis, van Schijndel & Linzen
(2021) find that estimates of the cost of word predictability derived from
language models severely underestimate the magnitude of human garden path
effects. In this work, we consider whether this underestimation is due to the
fact that humans weight syntactic factors in their predictions more highly than
language models do. We propose a method for estimating syntactic predictability
from a language model, allowing us to weigh the cost of lexical and syntactic
predictability independently. We find that treating syntactic predictability
independently from lexical predictability indeed results in larger estimates of
garden path. At the same time, even when syntactic predictability is
independently weighted, surprisal still greatly underestimate the magnitude of
human garden path effects. Our results support the hypothesis that
predictability is not the only factor responsible for the processing cost
associated with garden path sentences.

研究人类阅读园路效应时，提出的 surprisal 理论假设阅读者的速度减慢是由于句子中每个单词的不可预测性。但最近的研究表明，该假设低估了句法预测的影响。作者提出了计算句法预测能力的方法，并发现将其与词汇预测能力区分开来可以更准确地估计园路效应的影响。然而，即使这样，surprisal 仍然远远低估了人类阅读园路效应的影响。