Convolutional Neural Networks (CNNs) have gained significant traction in the
field of machine learning, particularly due to their high accuracy in visual
recognition. Recent works have pushed the performance of GPU implementations of
CNNs to significantly improve their classification and training times. With
these improvements, many frameworks have become available for implementing CNNs
on both CPUs and GPUs, with no support for FPGA implementations. In this work
we present a modified version of the popular CNN framework Caffe, with FPGA
support. This allows for classification using CNN models and specialized FPGA
implementations with the flexibility of reprogramming the device when
necessary, seamless memory transactions between host and device, simple-to-use
test benches, and the ability to create pipelined layer implementations. To
validate the framework, we use the Xilinx SDAccel environment to implement an
FPGA-based Winograd convolution engine and show that the FPGA layer can be used
alongside other layers running on a host processor to run several popular CNNs
(AlexNet, GoogleNet, VGG A, Overfeat). The results show that our framework
achieves 50 GFLOPS across 3x3 convolutions in the benchmarks. This is achieved
within a practical framework, which will aid in future development of
FPGA-based CNNs.

本文介绍了一种修改版 CNN 框架 Caffe，该框架支持 FPGA 实现，并使用 Xilinx SDAccel 环境实现了基于 FPGA 的 Winograd 卷积引擎，能够与其他运行在主机处理器上的层一起运行几个流行的 CNN 模型，取得了 50 GFLOPS 的成果。