We present GRIP, a graph neural network accelerator architecture designed for
low-latency inference. AcceleratingGNNs is challenging because they combine two
distinct types of computation: arithmetic-intensive vertex-centric operations
and memory-intensive edge-centric operations. GRIP splits GNN inference into a
fixed set of edge- and vertex-centric execution phases that can be implemented
in hardware. We then specialize each unit for the unique computational
structure found in each phase.For vertex-centric phases, GRIP uses a high
performance matrix multiply engine coupled with a dedicated memory subsystem
for weights to improve reuse. For edge-centric phases, GRIP use multiple
parallel prefetch and reduction engines to alleviate the irregularity in memory
accesses. Finally, GRIP supports severalGNN optimizations, including a novel
optimization called vertex-tiling which increases the reuse of weight data.We
evaluate GRIP by performing synthesis and place and route for a 28nm
implementation capable of executing inference for several widely-used GNN
models (GCN, GraphSAGE, G-GCN, and GIN). Across several benchmark graphs, it
reduces 99th percentile latency by a geometric mean of 17x and 23x compared to
a CPU and GPU baseline, respectively, while drawing only 5W.

GRIP 是一个用于低延迟推断的图神经网络加速器体系结构，它将 GNN 推断分为一组固定的边界和顶点中心执行阶段。它使用高性能矩阵乘法引擎以及专用的权重存储器来提高重用性，并通过多个并行预取和约简引擎来缓解存储器访问的不规则性。它支持几个 GNN 优化，包括称为 “顶点平铺” 的新优化，可以提高权重数据的重用。