While Transformer-based neural machine translation (NMT) is very effective in
high-resource settings, many languages lack the necessary large parallel
corpora to benefit from it. In the context of low-resource (LR) MT between two
closely-related languages, a natural intuition is to seek benefits from
structural "shortcuts", such as copying subwords from the source to the target,
given that such language pairs often share a considerable number of identical
words, cognates, and borrowings. We test Pointer-Generator Networks for this
purpose for six language pairs over a variety of resource ranges, and find weak
improvements for most settings. However, analysis shows that the model does not
show greater improvements for closely-related vs. more distant language pairs,
or for lower resource ranges, and that the models do not exhibit the expected
usage of the mechanism for shared subwords. Our discussion of the reasons for
this behaviour highlights several general challenges for LR NMT, such as modern
tokenization strategies, noisy real-world conditions, and linguistic
complexities. We call for better scrutiny of linguistically motivated
improvements to NMT given the blackbox nature of Transformer models, as well as
for a focus on the above problems in the field.

在低资源机器翻译中，通过 Transformer 网络结构的结构性快捷方式，如从源语言复制子词到目标语言，可以为近缘语言对之间的机器翻译提供微弱的改进，但并不展现与远缘语言对或低资源范围下相似语言对之间更强的改进，并且模型对于共享子词的机制使用并不如预期，这突显了低资源机器翻译领域面临的诸多挑战，如现代分词策略、嘈杂的真实环境和语言复杂性，并呼吁对 Transformer 模型进行更好的语言学动机改进的审视及对该领域上述问题的关注。

低资源机器翻译的指针生成网络：不要复制！

Pointer-Generator Networks for Low-Resource Machine Translation: Don't  Copy That!

Recent advances in neural sequence-to-sequence models have led to promising
results for several language generation-based tasks, including dialogue
response generation, summarization, and machine translation. However, these
models are known to have several problems, especially in the context of
chit-chat based dialogue systems: they tend to generate short and dull
responses that are often too generic. Furthermore, these models do not ground
conversational responses on knowledge and facts, resulting in turns that are
not accurate, informative and engaging for the users. In this paper, we propose
and experiment with a series of response generation models that aim to serve in
the general scenario where in addition to the dialogue context, relevant
unstructured external knowledge in the form of text is also assumed to be
available for models to harness. Our proposed approach extends
pointer-generator networks (See et al., 2017) by allowing the decoder to
hierarchically attend and copy from external knowledge in addition to the
dialogue context. We empirically show the effectiveness of the proposed model
compared to several baselines including (Ghazvininejad et al., 2018; Zhang et
al., 2018) through both automatic evaluation metrics and human evaluation on
CONVAI2 dataset.

本文提出了一种基于指针生成网络的响应生成模型，通过加入外部知识以及对话上下文，模型能够在对话系统中生成更加准确、丰富、有趣的响应，并在 CONVAI2 数据集上与几种基准模型进行比较和评估。