TL;DR通过挖掘遮挡推理的方式,运用曲面拟合算法,将 3D 绘制曲线转化为曲面,以构建有结构的 3D 重建场景。
Abstract
The three-dimensional reconstruction of scenes from multiple views has made
impressive strides in recent years, chiefly by methods correlating isolated
feature points, intensities, or curvilinear structure. In the general setting,
i.e., without requiring controlled acquisition, limited number of objects,
abundant patterns on objects, or object curves to foll
我们提出了 OpenOcc,一种将 3D 场景重建和开放词汇理解与神经辐射场结合的新型框架。通过占位表示法对场景的几何结构进行建模,并通过体素渲染将预训练的开放词汇模型蒸馏为 3D 语言场,以实现零 - shot 推理。此外,我们提出了一种新颖的语义感知置信度传播(SCP)方法,以缓解由于蒸馏特征中不一致测量而引起的语言场表示退化问题。实验证明,我们的方法在 3D 场景理解任务中取得了有竞争力的性能,特别是对于小物体和长尾物体。