The accuracy of monocular 3D human pose estimation depends on the viewpoint
from which the image is captured. While freely moving cameras, such as on
drones, provide control over this viewpoint, automatically positioning them at
the location which will yield the highest accuracy remains an open problem.
This is the problem that we address in this paper. Specifically, given a short
video sequence, we introduce an algorithm that predicts which viewpoints should
be chosen to capture future frames so as to maximize 3D human pose estimation
accuracy. The key idea underlying our approach is a method to estimate the
uncertainty of the 3D body pose estimates. We integrate several sources of
uncertainty, originating from deep learning based regressors and temporal
smoothness. Our motion planner yields improved 3D body pose estimates and
outperforms or matches existing ones that are based on person following and
orbiting.

本论文提出一种基于算法规划的视角控制方法，通过估算 3D 人体姿势估计的不确定性，结合基于深度学习的回归器和时间平滑性等多个不确定性来源，实现了更为准确的 3D 姿态估计，其性能优于基于人物跟随和围绕的相关研究。

ActiveMoCap: 用于主动人体运动捕捉的优化视角选择

ActiveMoCap: Optimized Viewpoint Selection for Active Human Motion  Capture

We present an approach that learns to synthesize high-quality, novel views of
3D objects or scenes, while providing fine-grained and precise control over the
6-DOF viewpoint. The approach is self-supervised and only requires 2D images
and associated view transforms for training. Our main contribution is a network
architecture that leverages a transforming auto-encoder in combination with a
depth-guided warping procedure to predict geometrically accurate unseen views.
Leveraging geometric constraints renders direct supervision via depth or flow
maps unnecessary. If large parts of the object are occluded in the source view,
a purely learning based prior is used to predict the values for dis-occluded
pixels. Our network furthermore predicts a per-pixel mask, used to fuse
depth-guided and pixel-based predictions. The resulting images reflect the
desired 6-DOF transformation and details are preserved. We thoroughly evaluate
our architecture on synthetic and real scenes and under fine-grained and
fixed-view settings. Finally, we demonstrate that the approach generalizes to
entirely unseen images such as product images downloaded from the internet.

本文提出了一个自监督学习的方法，通过深度引导的调整过程，利用变换自编码器的网络结构，在只有 2D 图像和相关视角变换的情况下精确合成高质量的 3D 对象或场景的新视角，并实现了细粒度和精密的六自由度视角控制。通过在合成和真实场景以及精细和固定视角设置下的彻底评估，证明了该方法的广泛适用性。