As the significance of simulation in medical care and intervention continues
to grow, it is anticipated that a simplified and low-cost platform can be set
up to execute personalized diagnoses and treatments. 3D Slicer can not only
perform medical image analysis and visualization but can also provide surgical
navigation and surgical planning functions. In this paper, we have chosen 3D
Slicer as our base platform and monocular cameras are used as sensors. Then, We
used the neural radiance fields (NeRF) algorithm to complete the 3D model
reconstruction of the human head. We compared the accuracy of the NeRF
algorithm in generating 3D human head scenes and utilized the MarchingCube
algorithm to generate corresponding 3D mesh models. The individual's head pose,
obtained through single-camera vision, is transmitted in real-time to the scene
created within 3D Slicer. The demonstrations presented in this paper include
real-time synchronization of transformations between the human head model in
the 3D Slicer scene and the detected head posture. Additionally, we tested a
scene where a tool, marked with an ArUco Maker tracked by a single camera,
synchronously points to the real-time transformation of the head posture. These
demos indicate that our methodology can provide a feasible real-time simulation
platform for nasopharyngeal swab collection or intubation.

我们使用 3D Slicer 作为基础平台，利用单目相机将人头进行 3D 模型重建，实时通过单目视觉传输头部姿态，并演示了利用 ArUco Marker 追踪工具实时指向头部姿态变化的可行性，为鼻咽拭子采集或插管等提供了一个可行的实时仿真平台。