Recent years have seen breakthroughs in neural language models that capture
nuances of language, culture, and knowledge. Neural networks are capable of
translating between languages -- in some cases even between two languages where
there is little or no access to parallel translations, in what is known as
Unsupervised Machine Translation (UMT). Given this progress, it is intriguing
to ask whether machine learning tools can ultimately enable understanding
animal communication, particularly that of highly intelligent animals. Our work
is motivated by an ambitious interdisciplinary initiative, Project CETI, which
is collecting a large corpus of sperm whale communications for machine
analysis.
We propose a theoretical framework for analyzing UMT when no parallel data
are available and when it cannot be assumed that the source and target corpora
address related subject domains or posses similar linguistic structure. The
framework requires access to a prior probability distribution that should
assign non-zero probability to possible translations. We instantiate our
framework with two models of language. Our analysis suggests that accuracy of
translation depends on the complexity of the source language and the amount of
``common ground'' between the source language and target prior.
We also prove upper bounds on the amount of data required from the source
language in the unsupervised setting as a function of the amount of data
required in a hypothetical supervised setting. Surprisingly, our bounds suggest
that the amount of source data required for unsupervised translation is
comparable to the supervised setting. For one of the language models which we
analyze we also prove a nearly matching lower bound.
Our analysis is purely information-theoretic and as such can inform how much
source data needs to be collected, but does not yield a computationally
efficient procedure.

我们提出了一个理论框架，用于分析无平行数据可用且源语料库与目标语料库不相干或具有相似语言结构时的 UMT，并且研究表明翻译准确性取决于源语言的复杂性和源语言与目标先验之间的 “共同基础”。

基于动物交流理解的无监督翻译理论

A Theory of Unsupervised Translation Motivated by Understanding Animal Communication

In this work, we study emergent communication through the lens of cooperative
multi-agent behavior in nature. Using insights from animal communication, we
propose a spectrum from low-bandwidth (e.g. pheromone trails) to high-bandwidth
(e.g. compositional language) communication that is based on the cognitive,
perceptual, and behavioral capabilities of social agents. Through a series of
experiments with pursuit-evasion games, we identify multi-agent reinforcement
learning algorithms as a computational model for the low-bandwidth end of the
communication spectrum.

研究团队通过对动物沟通的洞察提出了一个低带宽至高带宽的通信光谱，通过研究追逐与逃脱的游戏，确定了多智能体强化学习算法作为低带宽通信的计算模型。