Sentence simplification aims to simplify the content and structure of complex
sentences, and thus make them easier to interpret for human readers, and easier
to process for downstream NLP applications. Recent advances in neural machine
translation have paved the way for novel approaches to the task. In this paper,
we adapt an architecture with augmented memory capacities called Neural
Semantic Encoders (Munkhdalai and Yu, 2017) for sentence simplification. Our
experiments demonstrate the effectiveness of our approach on different
simplification datasets, both in terms of automatic evaluation measures and
human judgments.

本文旨在借助神经机器翻译中的一种新方法 —— 神经语义编码器，对句子简化这一任务进行了研究，实验结果表明，该方法在不同简化数据集上的自动评估措施和人工评估方面都表现出了显著的效果。

记忆增强神经网络的句子简化

Sentence Simplification with Memory-Augmented Neural Networks

We investigate evaluation metrics for dialogue response generation systems
where supervised labels, such as task completion, are not available. Recent
works in response generation have adopted metrics from machine translation to
compare a model's generated response to a single target response. We show that
these metrics correlate very weakly with human judgements in the non-technical
Twitter domain, and not at all in the technical Ubuntu domain. We provide
quantitative and qualitative results highlighting specific weaknesses in
existing metrics, and provide recommendations for future development of better
automatic evaluation metrics for dialogue systems.

本文研究对话响应生成系统的评估指标，其中没有可用的监督标签。最近，对话响应生成的研究采用了机器翻译的指标来比较模型生成的响应和单个目标响应。我们展示了这些指标与非技术 Twitter 领域中的人类判断之间的关系非常弱，而在技术 Ubuntu 领域中根本没有。我们提供了定量和定性结果，突出了现有指标的特定弱点，并提供了未来开发更好的自动评估指标的建议。

如何不评估您的对话系统：对话响应生成任务无监督评估指标的实证研究

How NOT To Evaluate Your Dialogue System: An Empirical Study of  Unsupervised Evaluation Metrics for Dialogue Response Generation

A common evaluation practice in the vector space models (VSMs) literature is
to measure the models' ability to predict human judgments about lexical
semantic relations between word pairs. Most existing evaluation sets, however,
consist of scores collected for English word pairs only, ignoring the potential
impact of the judgment language in which word pairs are presented on the human
scores. In this paper we translate two prominent evaluation sets, wordsim353
(association) and SimLex999 (similarity), from English to Italian, German and
Russian and collect scores for each dataset from crowdworkers fluent in its
language. Our analysis reveals that human judgments are strongly impacted by
the judgment language. Moreover, we show that the predictions of monolingual
VSMs do not necessarily best correlate with human judgments made with the
language used for model training, suggesting that models and humans are
affected differently by the language they use when making semantic judgments.
Finally, we show that in a large number of setups, multilingual VSM combination
results in improved correlations with human judgments, suggesting that
multilingualism may partially compensate for the judgment language effect on
human judgments.

本研究旨在通过将两个英文评估集（Wordsim353 和 SimLex999）翻译成意大利语、德语和俄语，并从熟悉该语言的人群工作者那里收集每个数据集的得分，以评估向量空间模型（VSM）在预测人类在其母语下对词汇语义关系的判断方面的能力，结果发现人类的判断结果强烈受到评判语言的影响，而多语言 VSM 的组合可以部分补偿评判语言对人类判断的影响。