Deep learning sequence models have been successfully applied to the task of morphological inflection. The results of the SIGMORPHON shared tasks in the past several years indicate that such models can perform well, but only if the training data cover a good amount of different lemmata, or if the lemmata that are inflected at test time have also been seen in training, as has indeed been largely the case in these tasks. Surprisingly, standard models such as the Transformer almost completely fail at generalizing inflection patterns when asked to inflect previously unseen lemmata -- i.e. under "wug test"-like circumstances. While established data augmentation techniques can be employed to alleviate this shortcoming by introducing a copying bias through hallucinating synthetic new word forms using the alphabet in the language at hand, we show that, to be more effective, the hallucination process needs to pay attention to substrings of syllable-like length rather than individual characters or stems. We report a significant performance improvement with our substring-based hallucination model over previous data hallucination methods when training and test data do not overlap in their lemmata.

研究表明，将深度学习序列模型用于形态学变化的任务可以取得良好的结果。然而标准模型，如Transformer，在推广变形模式方面表现很差。为了解决这个问题，我们提出了一种基于子串的生成模型，能够更好地处理之前没有训练过的词形，并在实验中获得了显著的性能提升。

Transformer能通过Wug测试吗？调整神经形态变化模型中的复制偏差