In this work, we addresses the problem of modeling distributions of graphs. We introduce the vector-quantized graph auto-encoder (VQ-GAE), a permutation-equivariant discrete auto-encoder and designed to model the distribution of graphs. By exploiting the permutation-equivariance of →