Zero-shot object detection aims to localize and recognize objects of unseen
classes. Most of existing works face two problems: the low recall of RPN in
unseen classes and the confusion of unseen classes with background. In this
paper, we present the first method that combines DETR and meta-learning to
perform zero-shot object detection, named Meta-ZSDETR, where model training is
formalized as an individual episode based meta-learning task. Different from
Faster R-CNN based methods that firstly generate class-agnostic proposals, and
then classify them with visual-semantic alignment module, Meta-ZSDETR directly
predict class-specific boxes with class-specific queries and further filter
them with the predicted accuracy from classification head. The model is
optimized with meta-contrastive learning, which contains a regression head to
generate the coordinates of class-specific boxes, a classification head to
predict the accuracy of generated boxes, and a contrastive head that utilizes
the proposed contrastive-reconstruction loss to further separate different
classes in visual space. We conduct extensive experiments on two benchmark
datasets MS COCO and PASCAL VOC. Experimental results show that our method
outperforms the existing ZSD methods by a large margin.

本文提出了一种结合 DETR 和元学习进行零样本目标检测的方法 Meta-ZSDETR，通过个体剧集为基础的元学习任务将模型训练形式化，直接使用类特定的查询进行类特定的边界框预测，并通过从分类头预测的准确性进一步过滤它们，利用提出的对比重建损失在视觉空间中进一步区分不同的类别。在 MS COCO 和 PASCAL VOC 两个基准数据集上进行了广泛实验，实验结果表明我们的方法在零样本目标检测方面优于现有的 ZSD 方法。