The emergence of complex life on Earth is often attributed to the arms race
that ensued from a huge number of organisms all competing for finite resources.
We present an artificial intelligence research environment, inspired by the
human game genre of MMORPGs (Massively Multiplayer Online Role-Playing Games,
a.k.a. MMOs), that aims to simulate this setting in microcosm. As with MMORPGs
and the real world alike, our environment is persistent and supports a large
and variable number of agents. Our environment is well suited to the study of
large-scale multiagent interaction: it requires that agents learn robust combat
and navigation policies in the presence of large populations attempting to do
the same. Baseline experiments reveal that population size magnifies and
incentivizes the development of skillful behaviors and results in agents that
outcompete agents trained in smaller populations. We further show that the
policies of agents with unshared weights naturally diverge to fill different
niches in order to avoid competition.

通过模拟 MMORPG 游戏和真实世界中的有限资源竞争环境，研究了大规模多智能体交互的学习和发展，实验表明，种群规模可以放大并刺激技能行为发展，产生优于小规模训练的代理人。