Open-world object detection (OWOD) is a challenging computer vision problem,
where the task is to detect a known set of object categories while
simultaneously identifying unknown objects. Additionally, the model must
incrementally learn new classes that become known in the next training
episodes. Distinct from standard object detection, the OWOD setting poses
significant challenges for generating quality candidate proposals on
potentially unknown objects, separating the unknown objects from the background
and detecting diverse unknown objects. Here, we introduce a novel end-to-end
transformer-based framework, OW-DETR, for open-world object detection. The
proposed OW-DETR comprises three dedicated components namely, attention-driven
pseudo-labeling, novelty classification and objectness scoring to explicitly
address the aforementioned OWOD challenges. Our OW-DETR explicitly encodes
multi-scale contextual information, possesses less inductive bias, enables
knowledge transfer from known classes to the unknown class and can better
discriminate between unknown objects and background. Comprehensive experiments
are performed on two benchmarks: MS-COCO and PASCAL VOC. The extensive
ablations reveal the merits of our proposed contributions. Further, our model
outperforms the recently introduced OWOD approach, ORE, with absolute gains
ranging from 1.8% to 3.3% in terms of unknown recall on MS-COCO. In the case of
incremental object detection, OW-DETR outperforms the state-of-the-art for all
settings on PASCAL VOC. Our code is available at
this https URL

通过引入一种新型的端到端基于 transformer 的框架 OW-DETR，其中包括 attention 驱动的伪标签、新颖性分类和对象得分三个组件，用于解决开放世界目标检测 (OWOD) 的挑战，在 MS-COCO 和 PASCAL VOC 数据集上的广泛实验表明，该模型表现出优秀的性能，能够从已知类中传递知识到未知类中，能够更好地鉴别未知对象和背景。