We propose a general method to train a single convolutional neural network
which is capable of switching image resolutions at inference. Thus the running
speed can be selected to meet various computational resource limits. Networks
trained with the proposed method are named Resolution Switchable Networks
(RS-Nets). The basic training framework shares network parameters for handling
images which differ in resolution, yet keeps separate batch normalization
layers. Though it is parameter-efficient in design, it leads to inconsistent
accuracy variations at different resolutions, for which we provide a detailed
analysis from the aspect of the train-test recognition discrepancy. A
multi-resolution ensemble distillation is further designed, where a teacher is
learnt on the fly as a weighted ensemble over resolutions. Thanks to the
ensemble and knowledge distillation, RS-Nets enjoy accuracy improvements at a
wide range of resolutions compared with individually trained models. Extensive
experiments on the ImageNet dataset are provided, and we additionally consider
quantization problems. Code and models are available at
this https URL

提出一种单卷积神经网络通用的方法，在推理时可以切换图像分辨率，从而可以选择满足各种计算资源限制的运行速度。用该方法训练的网络称为分辨率切换网络（RS-Nets）。通过多分辨率蒸馏和知识蒸馏，RS-Nets 在各种分辨率下的准确性得到了提高。