Grammatical Error Correction (GEC) systems play a vital role in assisting people with their daily writing tasks. However, users may sometimes come across a GEC system that initially performs well but fails to correct errors when the inputs are slightly modified. To ensure an ideal user experience, a reliable GEC system should have the ability to provide consistent and accurate suggestions when encountering irrelevant context perturbations, which we refer to as context robustness. In this paper, we introduce RobustGEC, a benchmark designed to evaluate the context robustness of GEC systems. RobustGEC comprises 5,000 GEC cases, each with one original error-correct sentence pair and five variants carefully devised by human annotators. Utilizing RobustGEC, we reveal that state-of-the-art GEC systems still lack sufficient robustness against context perturbations. In addition, we propose a simple yet effective method for remitting this issue.

介绍了 RobustGEC 基准系统，用于评估 GEC 系统的上下文鲁棒性；通过使用 RobustGEC，揭示了目前最先进的 GEC 系统在应对上下文扰动方面仍然缺乏足够的鲁棒性，并提出了一种简单而有效的方法来纠正这个问题。

RobustGEC：针对细微上下文扰动的鲁棒语法错误修正