We present an approach to depth estimation that fuses information from a stereo pair with sparse range measurements derived from a LIDAR sensor or a range camera. The goal of this work is to exploit the complementary strengths of the two sensor modalities, the accurate but sparse range measurements and the ambiguous but dense stereo information. These two sources are effectively and efficiently fused by combining ideas from anisotropic diffusion and semi-global matching. We evaluate our approach on the KITTI 2015 and Middlebury 2014 datasets, using randomly sampled ground truth range measurements as our sparse depth input. We achieve significant performance improvements with a small fraction of range measurements on both datasets. We also provide qualitative results from our platform using the PMDTec Monstar sensor. Our entire pipeline runs on an NVIDIA TX-2 platform at 5Hz on 1280x1024 stereo images with 128 disparity levels.

本研究提出了一种深度估计方法，利用来自双目立体视觉和稀疏激光雷达或深度相机的测量信息。通过融合各传感器的优势，即精确但稀疏的测量信息和模糊但密集的立体信息，并采用各向异性扩散和半全局匹配技术进行有效地融合。该方法在KITTI 2015和Middlebury 2014数据集上评估，表现显著，而且使用PMDTec Monstar传感器提供了定量结果。

利用稀疏深度测量与立体匹配融合实时稠密深度估计