Many multi-domain neural machine translation (NMT) models achieve knowledge
transfer by enforcing one encoder to learn shared embedding across domains.
However, this design lacks adaptation to individual domains. To overcome this
limitation, we propose a novel multi-domain NMT model using individual modules
for each domain, on which we apply word-level, adaptive and layer-wise domain
mixing. We first observe that words in a sentence are often related to multiple
domains. Hence, we assume each word has a domain proportion, which indicates
its domain preference. Then word representations are obtained by mixing their
embedding in individual domains based on their domain proportions. We show this
can be achieved by carefully designing multi-head dot-product attention modules
for different domains, and eventually taking weighted averages of their
parameters by word-level layer-wise domain proportions. Through this, we can
achieve effective domain knowledge sharing, and capture fine-grained
domain-specific knowledge as well. Our experiments show that our proposed model
outperforms existing ones in several NMT tasks.

本篇论文提出了使用独立词向量模块和基于词级别注意力机制的领域混合方法来实现多领域神经机器翻译的知识共享和精细化领域特定知识获取，实验结果表明该模型在多项 NMT 任务中表现优秀。