Existing point cloud modeling datasets primarily express the modeling
precision by pose or trajectory precision rather than the point cloud modeling
effect itself. Under this demand, we first independently construct a set of
LiDAR system with an optical stage, and then we build a HPMB dataset based on
the constructed LiDAR system, a High-Precision, Multi-Beam, real-world dataset.
Second, we propose an modeling evaluation method based on HPMB for object-level
modeling to overcome this limitation. In addition, the existing point cloud
modeling methods tend to generate continuous skeletons of the global
environment, hence lacking attention to the shape of complex objects. To tackle
this challenge, we propose a novel learning-based joint framework, DSMNet, for
high-precision 3D surface modeling from sparse point cloud frames. DSMNet
comprises density-aware Point Cloud Registration (PCR) and geometry-aware Point
Cloud Sampling (PCS) to effectively learn the implicit structure feature of
sparse point clouds. Extensive experiments demonstrate that DSMNet outperforms
the state-of-the-art methods in PCS and PCR on Multi-View Partial Point Cloud
(MVP) database. Furthermore, the experiments on the open source KITTI and our
proposed HPMB datasets show that DSMNet can be generalized as a post-processing
of Simultaneous Localization And Mapping (SLAM), thereby improving modeling
precision in environments with sparse point clouds.

该研究提出了一种基于 HPMB 数据集的建模评估方法和一种针对稀疏点云帧的高精度三维表面建模的联合学习框架 DSMNet，通过实验表明，DSMNet 在 Multi-View Partial Point Cloud (MVP) 数据库上的表现优于当今最先进的方法，并可以广泛应用于稀疏点云环境中的同时定位和地图构建 (SLAM) 的后处理，从而提高了建模精度。

DSMNet: 从稀疏点云帧中进行深度高精度三维表面建模

DSMNet: Deep High-precision 3D Surface Modeling from Sparse Point Cloud  Frames

Visual context provides grounding information for multimodal machine
translation (MMT). However, previous MMT models and probing studies on visual
features suggest that visual information is less explored in MMT as it is often
redundant to textual information. In this paper, we propose an object-level
visual context modeling framework (OVC) to efficiently capture and explore
visual information for multimodal machine translation. With detected objects,
the proposed OVC encourages MMT to ground translation on desirable visual
objects by masking irrelevant objects in the visual modality. We equip the
proposed with an additional object-masking loss to achieve this goal. The
object-masking loss is estimated according to the similarity between masked
objects and the source texts so as to encourage masking source-irrelevant
objects. Additionally, in order to generate vision-consistent target words, we
further propose a vision-weighted translation loss for OVC. Experiments on MMT
datasets demonstrate that the proposed OVC model outperforms state-of-the-art
MMT models and analyses show that masking irrelevant objects helps grounding in
MMT.

本文提出了一种基于物体级别视觉上下文建模的多模态机器翻译框架，采用对象掩模技术在可视模态下掩盖与源文本不相关的对象以实现翻译的视觉基础，同时引入了视觉加权翻译损失提高目标语言的视觉一致性，实验表明该模型优于现有的多模态机器翻译模型。