Learning target side syntactic structure has been shown to improve Neural
Machine Translation (NMT). However, incorporating syntax through latent
variables introduces additional complexity in inference, as the models need to
marginalize over the latent syntactic structures. To avoid this, models often
resort to greedy search which only allows them to explore a limited portion of
the latent space. In this work, we introduce a new latent variable model,
LaSyn, that captures the co-dependence between syntax and semantics, while
allowing for effective and efficient inference over the latent space. LaSyn
decouples direct dependence between successive latent variables, which allows
its decoder to exhaustively search through the latent syntactic choices, while
keeping decoding speed proportional to the size of the latent variable
vocabulary. We implement LaSyn by modifying a transformer-based NMT system and
design a neural expectation maximization algorithm that we regularize with
part-of-speech information as the latent sequences. Evaluations on four
different MT tasks show that incorporating target side syntax with LaSyn
improves both translation quality, and also provides an opportunity to improve
diversity.

本文介绍一种新的基于 latent variable 的神经机器翻译模型 LaSyn，通过修改基于 transformer 的 NMT 系统并使用基于词性信息的神经期望最大化算法作为 latent sequences 的正则化方法，实现了对目标语言句子结构的有效和高效推理，从而提高了翻译的质量和多样性。