In this work, we propose a novel approach to prioritize the depth map
computation of multi-view stereo (MVS) to obtain compact 3D point clouds of
high quality and completeness at low computational cost. Our prioritization
approach operates before the MVS algorithm is executed and consists of two
steps. In the first step, we aim to find a good set of matching partners for
each view. In the second step, we rank the resulting view clusters (i.e. key
views with matching partners) according to their impact on the fulfillment of
desired quality parameters such as completeness, ground resolution and
accuracy. Additional to geometric analysis, we use a novel machine learning
technique for training a confidence predictor. The purpose of this confidence
predictor is to estimate the chances of a successful depth reconstruction for
each pixel in each image for one specific MVS algorithm based on the RGB images
and the image constellation. The underlying machine learning technique does not
require any ground truth or manually labeled data for training, but instead
adapts ideas from depth map fusion for providing a supervision signal. The
trained confidence predictor allows us to evaluate the quality of image
constellations and their potential impact to the resulting 3D reconstruction
and thus builds a solid foundation for our prioritization approach. In our
experiments, we are thus able to reach more than 70% of the maximal reachable
quality fulfillment using only 5% of the available images as key views. For
evaluating our approach within and across different domains, we use two
completely different scenarios, i.e. cultural heritage preservation and
reconstruction of single family houses.

本文提出了一种新的多视图立体（MVS）深度图计算优先级方法，该优先级方法在 MVS 算法执行之前进行两步操作，包括寻找匹配伙伴并根据观测质量对结果进行排名，另外还使用了一种基于机器学习的信心预测器，能够对图像星座的质量进行评估，并提出一种优先级方法来构建稳固的三维重建基础，实验表明使用该方法能够在文化遗产保护和建造重建领域中达到更好的重建质量。