This paper introduces a Transformer-based integrative feature and cost
aggregation network designed for dense matching tasks. In the context of dense
matching, many works benefit from one of two forms of aggregation: feature
aggregation, which pertains to the alignment of similar features, or cost
aggregation, a procedure aimed at instilling coherence in the flow estimates
across neighboring pixels. In this work, we first show that feature aggregation
and cost aggregation exhibit distinct characteristics and reveal the potential
for substantial benefits stemming from the judicious use of both aggregation
processes. We then introduce a simple yet effective architecture that harnesses
self- and cross-attention mechanisms to show that our approach unifies feature
aggregation and cost aggregation and effectively harnesses the strengths of
both techniques. Within the proposed attention layers, the features and cost
volume both complement each other, and the attention layers are interleaved
through a coarse-to-fine design to further promote accurate correspondence
estimation. Finally at inference, our network produces multi-scale predictions,
computes their confidence scores, and selects the most confident flow for final
prediction. Our framework is evaluated on standard benchmarks for semantic
matching, and also applied to geometric matching, where we show that our
approach achieves significant improvements compared to existing methods.

本论文介绍了一种基于 Transformer 的综合特征和成本聚合网络，用于密集匹配任务。我们展示了特征聚合和成本聚合的不同特点，并介绍了一种简单而有效的架构，利用自注意力机制和互注意力机制来统一特征聚合和成本聚合，从而在语义匹配和几何匹配任务中实现了显著的改进。