Binary Neural Networks (BNNs) are receiving an upsurge of attention for
bringing power-hungry deep learning towards edge devices. The traditional
wisdom in this space is to employ sign() for binarizing featuremaps. We argue
and illustrate that sign() is a uniqueness bottleneck, limiting information
propagation throughout the network. To alleviate this, we propose to dispense
sign(), replacing it with a learnable activation binarizer (LAB), allowing the
network to learn a fine-grained binarization kernel per layer - as opposed to
global thresholding. LAB is a novel universal module that can seamlessly be
integrated into existing architectures. To confirm this, we plug it into four
seminal BNNs and show a considerable performance boost at the cost of tolerable
increase in delay and complexity. Finally, we build an end-to-end BNN (coined
as LAB-BNN) around LAB, and demonstrate that it achieves competitive
performance on par with the state-of-the-art on ImageNet.

本文提出了一种名为 LAB 的可学习二值化激励技术，替代二元特征映射中的 sign () 函数，其可以适用于各种已有的架构中，实验证明这种方法可以在不显著增加时间和复杂度的情况下，为四个二值神经网络模型带来明显性能提升，并在 ImageNet 数据集上实现了与最先进模型相同的性能。