We present a tree-structured network architecture for large-scale image classification. The trunk of the network contains convolutional layers optimized over all classes. At a given depth, the trunk splits into separate branches, each dedicated to discriminate a different subset of classes. Each branch acts as an expert classifying a set of categories that are difficult to tell apart, while the trunk provides common knowledge to all experts in the form of shared features. The training of our "network of experts" is completely end-to-end: the partition of categories into disjoint subsets is learned simultaneously with the parameters of the network trunk and the experts are trained jointly by minimizing a single learning objective over all classes. The proposed structure can be built from any existing convolutional neural network (CNN). We demonstrate its generality by adapting 3 popular CNNs for image categorization into the form of networks of experts. Our experiments on CIFAR100 and ImageNet show that in each case our method yields a substantial improvement in accuracy over the base CNN, and gives the best reported result on CIFAR100. Finally, the improvement in accuracy comes at little additional cost: compared to the base network, the training time of our model is about 1.5X and the number of parameters is comparable or in some cases even lower.

本文提出了一种基于树状结构的神经网络架构，用于大规模图像分类，并将其成功应用在四种流行卷积神经网络上，最终在CIFAR100数据集上达到了迄今为止最好的分类准确度，且在训练时间和参数数量上增加并不多。

大规模图像分类专家网络