Language models generate texts by successively predicting probability
distributions for next tokens given past ones. A growing field of interest
tries to leverage external information in the decoding process so that the
generated texts have desired properties, such as being more natural, non toxic,
faithful, or having a specific writing style. A solution is to use a classifier
at each generation step, resulting in a cooperative environment where the
classifier guides the decoding of the language model distribution towards
relevant texts for the task at hand. In this paper, we examine three families
of (transformer-based) discriminators for this specific task of cooperative
decoding: bidirectional, left-to-right and generative ones. We evaluate the
pros and cons of these different types of discriminators for cooperative
generation, exploring respective accuracy on classification tasks along with
their impact on the resulting sample quality and computational performances. We
also provide the code of a batched implementation of the powerful cooperative
decoding strategy used for our experiments, the Monte Carlo Tree Search,
working with each discriminator for Natural Language Generation.

本文研究语言模型在生成自然文本时采用协同解码策略，使用三种基于 Transformer 的分类器，并提供用于实验的基于 Monte Carlo Tree Search 的批量实现代码，比较它们在分类准确性、样本质量和计算性能等方面的优缺点。