We present the results of the second Neural MMO challenge, hosted at IJCAI 2022, which received 1600+ submissions. This competition targets robustness and generalization in multi-agent systems: participants train teams of agents to complete a multi-task objective against opponents not seen during training. The competition combines relatively complex environment design with large numbers of agents in the environment. The top submissions demonstrate strong success on this task using mostly standard reinforcement learning (RL) methods combined with domain-specific engineering. We summarize the competition design and results and suggest that, as an academic community, competitions may be a powerful approach to solving hard problems and establishing a solid benchmark for algorithms. We will open-source our benchmark including the environment wrapper, baselines, a visualization tool, and selected policies for further research.

第二届Neural MMO挑战赛的结果表明，在多智能体系统中的鲁棒性和泛化性能上取得了令人满意的成果，参与者通过使用标准强化学习方法结合领域特定的工程技术，训练出能够在与训练过程中未见过的对手下完成多任务目标的智能体团队。该挑战赛的设计和结果总结表明，作为学术界的一种强有力的方法，竞赛可以解决难题并为算法建立可靠的基准。我们将开源我们的基准测试，包括环境封装器、基准模型、可视化工具和选定的策略，以供进一步研究。

多智能体系统中的鲁棒性和泛化性能基准测试：神经互动多人在线游戏案例研究