In this paper, we present a dynamically reconfigurable hardware accelerator
called FADES (Fused Architecture for DEnse and Sparse matrices). The FADES
design offers multiple configuration options that trade off parallelism and
complexity using a dataflow model to create four stages that read, compute,
scale and write results. FADES is mapped to the programmable logic (PL) and
integrated with the TensorFlow Lite inference engine running on the processing
system (PS) of a heterogeneous SoC device. The accelerator is used to compute
the tensor operations, while the dynamically reconfigurable approach can be
used to switch precision between int8 and float modes. This dynamic
reconfiguration enables better performance by allowing more cores to be mapped
to the resource-constrained device and lower power consumption compared with
supporting both arithmetic precisions simultaneously. We compare the proposed
hardware with a high-performance systolic architecture for dense matrices
obtaining 25% better performance in dense mode with half the DSP blocks in the
same technology. In sparse mode, we show that the core can outperform dense
mode even at low sparsity levels, and a single-core achieves up to 20x
acceleration over the software-optimized NEON RUY library.

本文提出了一种动态可重构的硬件加速器 FADES，其使用数据流模型创建读取、计算、缩放和写入结果四个阶段，可用于张量运算的动态重配置，同时支持 int8 和 float 精度切换，具有更好的性能和更低的功耗。