Neural models with an encoder-decoder framework provide a feasible solution
to Question Generation (QG). However, after analyzing the model vocabulary we
find that current models (both RNN-based and pre-training based) have more than
23\% inflected forms. As a result, the encoder will generate separate
embeddings for the inflected forms, leading to a waste of training data and
parameters. Even worse, in decoding these models are vulnerable to irrelevant
noise and they suffer from high computational costs. In this paper, we propose
an approach to enhance the performance of QG by fusing word transformation.
Firstly, we identify the inflected forms of words from the input of encoder,
and replace them with the root words, letting the encoder pay more attention to
the repetitive root words. Secondly, we propose to adapt QG as a combination of
the following actions in the encode-decoder framework: generating a question
word, copying a word from the source sequence or generating a word
transformation type. Such extension can greatly decrease the size of predicted
words in the decoder as well as noise. We apply our approach to a typical
RNN-based model and \textsc{UniLM} to get the improved versions. We conduct
extensive experiments on SQuAD and MS MARCO datasets. The experimental results
show that the improved versions can significantly outperform the corresponding
baselines in terms of BLEU, ROUGE-L and METEOR as well as time cost.

本文研究了现有 RNN-based 和预训练语言模型在提问生成中使用 encoder-decoder 架构的性能问题，在此基础上提出了利用词形变换来改善提问生成性能的方法，并在 SQuAD 和 MS MARCO 数据集上进行实验证明，相比对应基线方法，改进后的方法在 BLEU、ROUGE-L 和 METEOR 指标以及时间成本方面都有显著提高。

问答生成模型中屈折形式是冗余的

Inflected Forms Are Redundant in Question Generation Models

The CoNLL-SIGMORPHON 2017 shared task on supervised morphological generation
required systems to be trained and tested in each of 52 typologically diverse
languages. In sub-task 1, submitted systems were asked to predict a specific
inflected form of a given lemma. In sub-task 2, systems were given a lemma and
some of its specific inflected forms, and asked to complete the inflectional
paradigm by predicting all of the remaining inflected forms. Both sub-tasks
included high, medium, and low-resource conditions. Sub-task 1 received 24
system submissions, while sub-task 2 received 3 system submissions. Following
the success of neural sequence-to-sequence models in the SIGMORPHON 2016 shared
task, all but one of the submissions included a neural component. The results
show that high performance can be achieved with small training datasets, so
long as models have appropriate inductive bias or make use of additional
unlabeled data or synthetic data. However, different biasing and data
augmentation resulted in disjoint sets of inflected forms being predicted
correctly, suggesting that there is room for future improvement.

该研究以 CoNLL-SIGMORPHON 2017 共享任务为基础，使用监督型形态生成技术在 52 种语言上进行训练和测试，结果表明神经序列到序列模型能够在小训练数据集上取得高性能，但由于不同偏置和数据增强策略导致预测的屈折形式集合不一，因此仍需要进一步的改进措施。