We study the problem of aligning a video that captures a local portion of an
environment to the 2D LiDAR scan of the entire environment. We introduce a
method (VioLA) that starts with building a semantic map of the local scene from
the image sequence, then extracts points at a fixed height for registering to
the LiDAR map. Due to reconstruction errors or partial coverage of the camera
scan, the reconstructed semantic map may not contain sufficient information for
registration. To address this problem, VioLA makes use of a pre-trained
text-to-image inpainting model paired with a depth completion model for filling
in the missing scene content in a geometrically consistent fashion to support
pose registration. We evaluate VioLA on two real-world RGB-D benchmarks, as
well as a self-captured dataset of a large office scene. Notably, our proposed
scene completion module improves the pose registration performance by up to
20%.

研究通过建立语义地图和利用图像序列与 LiDAR 扫描进行地点对齐的问题。提出了一种名为 VioLA 的方法，在固定高度提取用于注册到 LiDAR 地图的点。使用预训练的文本到图像修复模型和深度补全模型填补缺失的场景内容以支持姿态注册。在两个真实的 RGB-D 基准数据集以及一个大型办公场景的自录数据集上对 VioLA 进行评估。尤其值得注意的是，我们提出的场景补全模块将姿态注册性能提高了 20%。

VioLA：将视频与 2D LiDAR 扫描对齐

VioLA: Aligning Videos to 2D LiDAR Scans

The paper investigates the utility of text-to-image inpainting models for
satellite image data. Two technical challenges of injecting structural guiding
signals into the generative process as well as translating the inpainted RGB
pixels to a wider set of MSI bands are addressed by introducing a novel
inpainting framework based on StableDiffusion and ControlNet as well as a novel
method for RGB-to-MSI translation. The results on a wider set of data suggest
that the inpainting synthesized via StableDiffusion suffers from undesired
artefacts and that a simple alternative of self-supervised internal inpainting
achieves higher quality of synthesis.

研究了文本到图像修复模型在卫星图像数据中的实用性，通过引入基于 StableDiffusion 和 ControlNet 的新型修复框架以及一种新的 RGB 到 MSI 转换方法，解决了将结构引导信号注入到生成过程中的两个技术挑战，以及将修复的 RGB 像素转换为更广泛的 MSI 波段。对更广泛的数据集的结果表明，通过 StableDiffusion 生成的修复结果存在不受欢迎的伪影，而自监督内部修复的简单替代方法具有更高的合成质量。