Advances in multicore processors and accelerators have opened the flood gates
to greater exploration and application of machine learning techniques to a
variety of applications. These advances, along with breakdowns of several
trends including Moore's Law, have prompted an explosion of processors and
accelerators that promise even greater computational and machine learning
capabilities. These processors and accelerators are coming in many forms, from
CPUs and GPUs to ASICs, FPGAs, and dataflow accelerators. This paper surveys
the current state of these processors and accelerators that have been publicly
announced with performance and power consumption numbers. The performance and
power values are plotted on a scatter graph and a number of dimensions and
observations from the trends on this plot are discussed and analyzed. For
instance, there are interesting trends in the plot regarding power consumption,
numerical precision, and inference versus training. We then select and
benchmark two commercially-available low size, weight, and power (SWaP)
accelerators as these processors are the most interesting for embedded and
mobile machine learning inference applications that are most applicable to the
DoD and other SWaP constrained users. We determine how they actually perform
with real-world images and neural network models, compare those results to the
reported performance and power consumption values and evaluate them against an
Intel CPU that is used in some embedded applications.

本文研究了公开宣布具有性能和功耗数字的多核处理器和加速器的现状，发现其中一些趋势，包括功耗、数字精度以及推理与训练等方面的趋势，并选择并测试了两个低尺寸、重量和功率的商用加速器的实际表现，将其与报道的性能和功耗数值进行比较，并将其与嵌入式应用程序中使用的 Intel CPU 进行评估。