Cooperative Multi-Agent Reinforcement Learning (MARL) necessitates seamless
collaboration among agents, often represented by an underlying relation graph.
Existing methods for learning this graph primarily focus on agent-pair
relations, neglecting higher-order relationships. While several approaches
attempt to extend cooperation modelling to encompass behaviour similarities
within groups, they commonly fall short in concurrently learning the latent
graph, thereby constraining the information exchange among partially observed
agents. To overcome these limitations, we present a novel approach to infer the
Group-Aware Coordination Graph (GACG), which is designed to capture both the
cooperation between agent pairs based on current observations and group-level
dependencies from behaviour patterns observed across trajectories. This graph
is further used in graph convolution for information exchange between agents
during decision-making. To further ensure behavioural consistency among agents
within the same group, we introduce a group distance loss, which promotes group
cohesion and encourages specialization between groups. Our evaluations,
conducted on StarCraft II micromanagement tasks, demonstrate GACG's superior
performance. An ablation study further provides experimental evidence of the
effectiveness of each component of our method.

我们提出了一种新的方法来推断组感知协作图（GACG），以捕捉基于当前观测到的代理之间的合作以及跨轨迹观察到的行为模式的组水平依赖关系，并在决策过程中使用该图进行信息交换。通过在 StarCraft II 微管理任务上进行评估，我们证明了 GACG 的卓越性能。进一步的消融研究为我们的方法的每个组成部分的有效性提供了实验证据。