In this paper, we point out that the essential differences between CNN-based
and Transformer-based detectors, which cause the worse performance of small
objects in Transformer-based methods, are the gap between local information and
global dependencies in feature extraction and propagation. To address these
differences, we propose a new vision Transformer, called Hybrid Network
Transformer (Hyneter), after pre-experiments that indicate the gap causes
CNN-based and Transformer-based methods to increase size-different objects
result unevenly. Different from the divide and conquer strategy in previous
methods, Hyneters consist of Hybrid Network Backbone (HNB) and Dual Switching
module (DS), which integrate local information and global dependencies, and
transfer them simultaneously. Based on the balance strategy, HNB extends the
range of local information by embedding convolution layers into Transformer
blocks, and DS adjusts excessive reliance on global dependencies outside the
patch.

本研究指出 CNN 和 Transformer 检测器之间的本质差别是特征提取和传播中的本地信息和全局依赖之间的差距，为了解决这些差异，我们提出了一种新的远景 Transformer，称为 Hybrid Network Transformer（Hyneter），该方法采用了平衡策略，在传递本地信息和全局依赖的同时，扩展了本地信息范围.