While NeRF-based human representations have shown impressive novel view synthesis results, most methods still rely on a large number of images / views for training. In this work, we propose a novel animatable NeRF called ActorsNeRF. It is first pre-trained on diverse human subjects, and then adapted with few-shot monocular video frames for a new actor with unseen poses. Building on previous generalizable NeRFs with parameter sharing using a ConvNet encoder, ActorsNeRF further adopts two human priors to capture the large human appearance, shape, and pose variations. Specifically, in the encoded feature space, we will first align different human subjects in a category-level canonical space, and then align the same human from different frames in an instance-level canonical space for rendering. We quantitatively and qualitatively demonstrate that ActorsNeRF significantly outperforms the existing state-of-the-art on few-shot generalization to new people and poses on multiple datasets. Project Page: https://jitengmu.github.io/ActorsNeRF/

本篇论文提出了一种新颖的可动态生成 NeRF 模型 ActorsNeRF, 采用少量新演员的单目视频帧进行自适应训练, 进一步采用两个人类先验来捕捉人类外观、形状和姿势变化, 并在多个数据集上定量和定性地证明 ActorsNeRF 在 few-shot 身份和姿势泛化方面明显优于现有最先进技术。

ActorsNeRF: 可动画的通用少样本人体渲染NeRF