There is a growing interest in automated neural architecture search (NAS). To
improve the efficiency of NAS, previous approaches adopt weight sharing method
to force all models share the same set of weights. However, it has been
observed that a model performing better with shared weights does not
necessarily perform better when trained alone. In this paper, we analyse
existing weight sharing one-shot NAS approaches from a Bayesian point of view
and identify the posterior fading problem, which compromises the effectiveness
of shared weights. To alleviate this problem, we present a practical approach
to guide the parameter posterior towards its true distribution. Moreover, a
hard latency constraint is introduced during the search so that the desired
latency can be achieved. The resulted method, namely Posterior Convergent NAS
(PC-NAS), achieves state-of-the-art performance under standard GPU latency
constraint on ImageNet. In our small search space, our model PC-NAS-S attains
76.8 % top-1 accuracy, 2.1% higher than MobileNetV2 (1.4x) with the same
latency. When adopted to the large search space, PC-NAS-L achieves 78.1 % top-1
accuracy within 11ms. The discovered architecture also transfers well to other
computer vision applications such as object detection and person
re-identification.

通过 Bayesian 分析，提出一种可实现后验均衡的神经网络架构搜索方法，该方法引入硬延迟约束，在满足标准 GPU 延迟约束的情况下，在 ImageNet 数据集上取得了最先进的性能，并在其他计算机视觉应用中实现了模型结构迁移。