Learning to cooperate is crucially important in multi-agent environments. The
key is to understand the mutual interplay between agents. However, multi-agent
environments are highly dynamic, where agents keep moving and their neighbors
change quickly. This makes it hard to learn abstrac