Recent advances in deep learning greatly boost the performance of object detection. State-of-the-art methods such as Faster-RCNN, FPN and R-FCN have achieved high accuracy in challenging benchmark datasets. However, these methods require fully annotated object bounding boxes for training, which are incredibly hard to scale up due to the high annotation cost. Weakly-supervised methods, on the other hand, only require image-level labels for training, but the performance is far below their fully-supervised counterparts. In this paper, we propose a semi-supervised large scale fine-grained detection method, which only needs bounding box annotations of a smaller number of coarse-grained classes and image-level labels of large scale fine-grained classes, and can detect all classes at nearly fully-supervised accuracy. We achieve this by utilizing the correlations between coarse-grained and fine-grained classes with shared backbone, soft-attention based proposal re-ranking, and a dual-level memory module. Experiment results show that our methods can achieve close accuracy on object detection to state-of-the-art fully-supervised methods on two large scale datasets, ImageNet and OpenImages, with only a small fraction of fully annotated classes.

本研究提出了一种半监督方法，只需要较少数量的粗粒度类别的边界框注释和大规模细粒度类别的图像级标签，即可实现接近完全监督检测的所有类别的检测精度，包括了使用共享骨干，基于软注意力的候选建议重排和双级存储器模块的相关性。实验证明，这种方法在 ImageNet 和 OpenImages这两个大规模数据集上，只有少部分类别进行完全注释就能够接近最先进的全监督方法。

大规模物体检测——无需细粒度边界框检测 11K 类