This paper targets interactive object-level editing(e.g., deletion,
recoloring, transformation, composition) in dynamic scenes. Recently, some
methods aiming for flexible editing static scenes represented by neural
radiance field (NeRF) have shown impressive synthesis quality, while similar
capabilities in time-variant dynamic scenes remain limited. To solve this
problem, we propose 4D-Editor, an interactive semantic-driven editing
framework, allowing editing multiple objects in dynamic NeRF based on user
strokes on a single frame. Our dynamic scene representation is built upon
hybrid semantic feature fields so that the spatial-temporal consistency can be
maintained after editing. In addition, we design recursive selection refinement
that significantly boosts segmentation accuracy in a dynamic NeRF to aid the
editing process. Moreover, we develop multi-view reprojection inpainting to
fill holes caused by incomplete scene capture after editing. Extensive
experiments and editing examples on real-world demonstrate that 4D-Editor
achieves photo-realistic dynamic NeRF editing. Project page:
this https URL

本文介绍了 4D-Editor，一种基于用户画笔在单帧上编辑动态 NeRF 中多个对象的交互式语义驱动编辑框架，通过混合的语义特征场构建动态场景表示以保持时空一致性，并使用递归选择细化方法加强了动态 NeRF 中的分割准确性，此外，还开发了多视图重投影修复方法，用于填补编辑后由于不完整场景捕捉而产生的空洞，通过实验和真实世界的编辑示例表明，4D-Editor 可以实现真实感的动态 NeRF 编辑。