Precise camera tracking, high-fidelity 3D tissue reconstruction, and
real-time online visualization are critical for intrabody medical imaging
devices such as endoscopes and capsule robots. However, existing SLAM
(Simultaneous Localization and Mapping) methods often struggle to achieve both
complete high-quality surgical field reconstruction and efficient computation,
restricting their intraoperative applications among endoscopic surgeries. In
this paper, we introduce EndoGSLAM, an efficient SLAM approach for endoscopic
surgeries, which integrates streamlined Gaussian representation and
differentiable rasterization to facilitate over 100 fps rendering speed during
online camera tracking and tissue reconstructing. Extensive experiments show
that EndoGSLAM achieves a better trade-off between intraoperative availability
and reconstruction quality than traditional or neural SLAM approaches, showing
tremendous potential for endoscopic surgeries. The project page is at
this https URL

EndoGSLAM 是一种用于内窥镜手术的高效 SLAM 方法，通过整合高速渲染和组织重建，实现在线相机跟踪和组织重建的 100 帧 / 秒渲染速度，具备优于传统或神经 SLAM 方法的手术过程中可用性和重建质量的平衡。

EndoGSLAM: 内窥镜手术中的实时稠密重建与跟踪，利用高斯喷涂

EndoGSLAM: Real-Time Dense Reconstruction and Tracking in Endoscopic  Surgeries using Gaussian Splatting

Purpose: Surgical scene understanding plays a critical role in the technology
stack of tomorrow's intervention-assisting systems in endoscopic surgeries. For
this, tracking the endoscope pose is a key component, but remains challenging
due to illumination conditions, deforming tissues and the breathing motion of
organs. Method: We propose a solution for stereo endoscopes that estimates
depth and optical flow to minimize two geometric losses for camera pose
estimation. Most importantly, we introduce two learned adaptive per-pixel
weight mappings that balance contributions according to the input image
content. To do so, we train a Deep Declarative Network to take advantage of the
expressiveness of deep-learning and the robustness of a novel geometric-based
optimization approach. We validate our approach on the publicly available
SCARED dataset and introduce a new in-vivo dataset, StereoMIS, which includes a
wider spectrum of typically observed surgical settings. Results: Our method
outperforms state-of-the-art methods on average and more importantly, in
difficult scenarios where tissue deformations and breathing motion are visible.
We observed that our proposed weight mappings attenuate the contribution of
pixels on ambiguous regions of the images, such as deforming tissues.
Conclusion: We demonstrate the effectiveness of our solution to robustly
estimate the camera pose in challenging endoscopic surgical scenes. Our
contributions can be used to improve related tasks like simultaneous
localization and mapping (SLAM) or 3D reconstruction, therefore advancing
surgical scene understanding in minimally-invasive surgery.

该研究提出一种基于双目内窥镜深度估计和光流的深度声明网络，通过减小两个几何损失优化相机姿态估计，并且引入了两个自适应的像素权重映射来平衡贡献，实现在挑战性的内窥镜手术场景中更加鲁棒的相机姿态估计，具有推进微创外科领域相关任务（如 SLAM 或 3D 重建）的研究意义。