There has been an increased interest in data generation approaches to
grammatical error correction (GEC) using pseudo data. However, these approaches
suffer from several issues that make them inconvenient for real-world
deployment including a demand for large amounts of training data. On the other
hand, some errors based on grammatical rules may not necessarily require a
large amount of data if GEC models can realize grammatical generalization. This
study explores to what extent GEC models generalize grammatical knowledge
required for correcting errors. We introduce an analysis method using synthetic
and real GEC datasets with controlled vocabularies to evaluate whether models
can generalize to unseen errors. We found that a current standard
Transformer-based GEC model fails to realize grammatical generalization even in
simple settings with limited vocabulary and syntax, suggesting that it lacks
the generalization ability required to correct errors from provided training
examples.

本研究探索了语法纠错模型的泛化能力，通过合成和真实的数据集来评估其泛化性，结果发现目前标准的 Transformer-based GEC 模型在有限的词汇和语法环境下仍无法实现语法归纳。