We present a High-Resolution Transformer (HRFormer) that learns
high-resolution representations for dense prediction tasks, in contrast to the
original Vision Transformer that produces low-resolution representations and
has high memory and computational cost. We take advantage of the
multi-resolution parallel design introduced in high-resolution convolutional
networks (HRNet), along with local-window self-attention that performs
self-attention over small non-overlapping image windows, for improving the
memory and computation efficiency. In addition, we introduce a convolution into
the FFN to exchange information across the disconnected image windows. We
demonstrate the effectiveness of the High-Resolution Transformer on both human
pose estimation and semantic segmentation tasks, e.g., HRFormer outperforms
Swin transformer by $1.3$ AP on COCO pose estimation with $50\%$ fewer
parameters and $30\%$ fewer FLOPs. Code is available at:
this https URL

本研究提出了一种名为 High-Resolution Transformer 的方法，用于学习密集预测任务中的高分辨率表示， 并取得了在人体姿态估计和语义分割任务中较好的结果。