The role concept provides a useful tool to design and understand complex
multi-agent systems, which allows agents with a similar role to share similar
behaviors. However, existing role-based methods use prior domain knowledge and
predefine role structures and behaviors. In contrast, multi-agent reinforcement
learning (MARL) provides flexibility and adaptability, but less efficiency in
complex tasks. In this paper, we synergize these two paradigms and propose a
role-oriented MARL framework (ROMA). In this framework, roles are emergent, and
agents with similar roles tend to share their learning and to be specialized on
certain sub-tasks. To this end, we construct a stochastic role embedding space
by introducing two novel regularizers and conditioning individual policies on
roles. Experiments show that our method can learn specialized, dynamic, and
identifiable roles, which help our method push forward the state of the art on
the StarCraft II micromanagement benchmark. Demonstrative videos are available
at this https URL

本文提出了一种基于角色的多智能体强化学习框架，称为 ROMA，用于推进 StarCraft II 微观管理基准测试的艺术水平，该框架中的角色是新兴的，代理人倾向于在某些子任务上专业化，并添加了新的规则器来构建随机的角色嵌入空间。