Reconstruction of deformable scenes from endoscopic videos is important for many applications such as intraoperative navigation, surgical visual perception, and robotic surgery. It is a foundational requirement for realizing autonomous robotic interventions for minimally invasive surgery. However, previous approaches in this domain have been limited by their modular nature and are confined to specific camera and scene settings. Our work adopts the Neural Radiance Fields (NeRF) approach to learning 3D implicit representations of scenes that are both dynamic and deformable over time, and furthermore with unknown camera poses. We demonstrate this approach on endoscopic surgical scenes from robotic surgery. This work removes the constraints of known camera poses and overcomes the drawbacks of the state-of-the-art unstructured dynamic scene reconstruction technique, which relies on the static part of the scene for accurate reconstruction. Through several experimental datasets, we demonstrate the versatility of our proposed model to adapt to diverse camera and scene settings, and show its promise for both current and future robotic surgical systems.

通过采用神经辐射场（NeRF）方法，我们展示了一种能够学习时间上动态且可变形的三维场景的方法，并能适应各种不同相机和场景设置的鲁棒性模型，该模型消除了已知相机姿态的限制，并克服了目前静态场景重构技术中依赖场景静态部分进行精准重构的缺点，为当前和未来的机器人外科手术系统提供了潜力。

基于束调整的外科内窥镜动态视频重建，使用神经辐射场