Adopting Neural Radiance Fields (NeRF) to long-duration dynamic sequences has been challenging. Existing methods struggle to balance between quality and storage size and encounter difficulties with complex scene changes such as topological changes and large motions. To tackle these issues, we propose a novel neural video-based radiance fields (NeVRF) representation. NeVRF marries neural radiance field with image-based rendering to support photo-realistic novel view synthesis on long-duration dynamic inward-looking scenes. We introduce a novel multi-view radiance blending approach to predict radiance directly from multi-view videos. By incorporating continual learning techniques, NeVRF can efficiently reconstruct frames from sequential data without revisiting previous frames, enabling long-duration free-viewpoint video. Furthermore, with a tailored compression approach, NeVRF can compactly represent dynamic scenes, making dynamic radiance fields more practical in real-world scenarios. Our extensive experiments demonstrate the effectiveness of NeVRF in enabling long-duration sequence rendering, sequential data reconstruction, and compact data storage.

NeVRF利用神经辐射场与基于图像的渲染相结合，通过引入新颖的多视图辐射混合方法从多视图视频中直接预测辐射，实现对长时间动态内视场景的逼真新视点合成。通过利用连续学习技术，NeVRF能够高效重构顺序数据的帧，不需要重新访问先前的帧，从而实现长时间自由视点视频。此外，通过一种量身定制的压缩方法，NeVRF能够紧凑地表示动态场景，在实际应用中使动态辐射场更加实用。我们的实验证明了NeVRF在实现长时间序列渲染、顺序数据重构和紧凑数据存储方面的有效性。

NeVRF：用于长时序列的神经视频辐射场