Non-autoregressive neural machine translation (NAT) generates each target
word in parallel and has achieved promising inference acceleration. However,
existing NAT models still have a big gap in translation quality compared to
autoregressive neural machine translation models due to the enormous decoding
space. To address this problem, we propose a novel NAT framework named
ReorderNAT which explicitly models the reordering information in the decoding
procedure. We further introduce deterministic and non-deterministic decoding
strategies that utilize reordering information to narrow the decoding search
space in our proposed ReorderNAT. Experimental results on various widely-used
datasets show that our proposed model achieves better performance compared to
existing NAT models, and even achieves comparable translation quality as
autoregressive translation models with a significant speedup.

本研究提出了一种名为 ReorderNAT 的新型非自回归神经机器翻译框架，该框架利用可确定性和不确定性解码战略以缩小解码空间，从而更好地模拟了编码过程中的重新排序信息，实验结果表明，该模型在各种广泛使用的数据集上表现出更好的性能，并且通过显着的加速实现了与自回归翻译模型相媲美的翻译质量。