Non-autoregressive translation (NAT) significantly accelerates the inference
process via predicting the entire target sequence. However, recent studies show
that NAT is weak at learning high-mode of knowledge such as one-to-many
translations. We argue that modes can be divided into various granularities
which can be learned from easy to hard. In this study, we empirically show that
NAT models are prone to learn fine-grained lower-mode knowledge, such as words
and phrases, compared with sentences. Based on this observation, we propose
progressive multi-granularity training for NAT. More specifically, to make the
most of the training data, we break down the sentence-level examples into three
types, i.e. words, phrases, sentences, and with the training goes, we
progressively increase the granularities. Experiments on Romanian-English,
English-German, Chinese-English, and Japanese-English demonstrate that our
approach improves the phrase translation accuracy and model reordering ability,
therefore resulting in better translation quality against strong NAT baselines.
Also, we show that more deterministic fine-grained knowledge can further
enhance performance.

本文证明 non-autoregressive translation 偏爱学习细粒度语言知识，并提出了逐步加深语言粒度的 multi-granularity training 方法，实验结果表明该方法能够提高短语翻译准确率、模型排序能力，并且更加确定的细粒度语言知识能进一步提升翻译质量。