Stereo matching is a fundamental task in scene comprehension. In recent
years, the method based on iterative optimization has shown promise in stereo
matching. However, the current iteration framework employs a single-peak
lookup, which struggles to handle the multi-peak problem effectively.
Additionally, the fixed search range used during the iteration process limits
the final convergence effects. To address these issues, we present a novel
iterative optimization architecture called MC-Stereo. This architecture
mitigates the multi-peak distribution problem in matching through the
multi-peak lookup strategy, and integrates the coarse-to-fine concept into the
iterative framework via the cascade search range. Furthermore, given that
feature representation learning is crucial for successful learnbased stereo
matching, we introduce a pre-trained network to serve as the feature extractor,
enhancing the front end of the stereo matching pipeline. Based on these
improvements, MC-Stereo ranks first among all publicly available methods on the
KITTI-2012 and KITTI-2015 benchmarks, and also achieves state-of-the-art
performance on ETH3D. The code will be open sourced after the publication of
this paper.

基于迭代优化的 MC-Stereo 框架通过多峰查找策略缓解了匹配中的多峰分布问题，并通过级联搜索范围将粗糙到精细的概念整合到迭代框架中，此外，引入预训练网络作为特征提取器提升了立体匹配流水线的前端，基于这些改进，MC-Stereo 在 KITTI-2012 和 KITTI-2015 基准测试中排名第一，并在 ETH3D 上实现了最先进的性能。