Probabilistic generative neural networks are useful for many applications,
such as image classification, speech recognition and occlusion removal.
However, the power budget for hardware implementations of neural networks can
be extremely tight. To address this challenge we describe a design methodology
for using approximate computing methods to implement Approximate Deep Belief
Networks (ApproxDBNs) by systematically exploring the use of (1) limited
precision of variables; (2) criticality analysis to identify the nodes in the
network which can operate with such limited precision while allowing the
network to maintain target accuracy levels; and (3) a greedy search methodology
with incremental retraining to determine the optimal reduction in precision to
enable maximize power savings under user-specified accuracy constraints.
Experimental results show that significant bit-length reduction can be achieved
by our ApproxDBN with constrained accuracy loss.

通过有限精度变量、关键性分析、贪婪策略等技术实现近似深置信网络 (ApproxDBNs)，在保证目标准确率的前提下，最大化降低硬件实现的能耗。实验结果表明，通过限制准确度损失，能够显著降低硬件的处理精度。