As a sub-discipline of evolutionary and computational linguistics, emergent
communication (EC) studies communication protocols, called emergent languages,
arising in simulations where agents communicate. A key goal of EC is to give
rise to languages that share statistical properties with natural languages. In
this paper, we reinterpret Lewis's signaling game, a frequently used setting in
EC, as beta-VAE and reformulate its objective function as ELBO. Consequently,
we clarify the existence of prior distributions of emergent languages and show
that the choice of the priors can influence their statistical properties.
Specifically, we address the properties of word lengths and segmentation, known
as Zipf's law of abbreviation (ZLA) and Harris's articulation scheme (HAS),
respectively. It has been reported that the emergent languages do not follow
them when using the conventional objective. We experimentally demonstrate that
by selecting an appropriate prior distribution, more natural segments emerge,
while suggesting that the conventional one prevents the languages from
following ZLA and HAS.

这篇论文介绍了一种基于进化和计算语言学的新兴通信（EC）研究，它研究模拟中的代理人通信产生的通信协议，称为新兴语言。研究重点是通过重新解释 Lewis 的信号游戏作为 beta-VAE，并将其目标函数重新表述为 ELBO，从而阐明了新兴语言的先验分布的存在，并展示了先验的选择如何影响其统计性质。实验结果表明，选择适当的先验分布能够产生更加自然的语言片段，而常规的先验则阻止语言遵循 Zipf 法则和 Harris 语音方案。

Lewis 的信号游戏作为 beta-VAE 用于自然词长度和分割

Lewis's Signaling Game as beta-VAE For Natural Word Lengths and Segments

Despite renewed interest in emergent language simulations with neural
networks, little is known about the basic properties of the induced code, and
how they compare to human language. One fundamental characteristic of the
latter, known as Zipf's Law of Abbreviation (ZLA), is that more frequent words
are efficiently associated to shorter strings. We study whether the same
pattern emerges when two neural networks, a "speaker" and a "listener", are
trained to play a signaling game. Surprisingly, we find that networks develop
an \emph{anti-efficient} encoding scheme, in which the most frequent inputs are
associated to the longest messages, and messages in general are skewed towards
the maximum length threshold. This anti-efficient code appears easier to
discriminate for the listener, and, unlike in human communication, the speaker
does not impose a contrasting least-effort pressure towards brevity. Indeed,
when the cost function includes a penalty for longer messages, the resulting
message distribution starts respecting ZLA. Our analysis stresses the
importance of studying the basic features of emergent communication in a highly
controlled setup, to ensure the latter will not strand too far from human
language. Moreover, we present a concrete illustration of how different
functional pressures can lead to successful communication codes that lack basic
properties of human language, thus highlighting the role such pressures play in
the latter.

研究了当两个神经网络，即 “说话人” 和 “听众” 被训练玩信号游戏时，是否会产生类似 Zipf 定律的现象，然而我们发现，这些神经网络没有按照 Zipf 定律的方式编码，即更常见的输入被分配到更长的消息中，这种反效率的编码方式对于监听者更容易进行区分，并且与人类沟通不同的是，说话人不会对简洁性施加压力，同时，当成本函数包括对更长消息的惩罚时，结果消息分布开始遵循 Zipf 定律。因此，该研究强调了在高度控制的设置中研究新兴沟通的基本特征的重要性，以确保后者不会偏离人类语言。