Recent studies have shown that introducing communication between agents can significantly improve overall performance in cooperative Multi-agent reinforcement learning (MARL). However, existing communication schemes often require agents to exchange an excessive number of messages at run-time under a reliable communication channel, which hinders its practicality in many real-world situations. In this paper, we present \textit{Temporal Message Control} (TMC), a simple yet effective approach for achieving succinct and robust communication in MARL. TMC applies a temporal smoothing technique to drastically reduce the amount of information exchanged between agents. Experiments show that TMC can significantly reduce inter-agent communication overhead without impacting accuracy. Furthermore, TMC demonstrates much better robustness against transmission loss than existing approaches in lossy networking environments.

本文介绍了一种简单且有效的方法，即‘时间消息控制’（TMC），用于在多智能体强化学习中实现简明而稳健的通信。实验表明，TMC可以在不影响准确性的情况下显著减少智能体间的通信开销，并且在易丢失网络环境中表现出比现有方法更好的鲁棒性。

具有时间消息控制的简洁强健多智体通信