Cross-view person matching and 3D human pose estimation in multi-camera
networks are particularly difficult when the cameras are extrinsically
uncalibrated. Existing efforts generally require large amounts of 3D data for
training neural networks or known camera poses for geometric constraints to
solve the problem. However, camera poses and 3D data annotation are usually
expensive and not always available. We present a method, PME, that solves the
two tasks without requiring either information. Our idea is to address
cross-view person matching as a clustering problem using each person as a
cluster center, then obtain correspondences from person matches, and estimate
3D human poses through multi-view triangulation and bundle adjustment. We solve
the clustering problem by introducing a "size constraint" using the number of
cameras and a "source constraint" using the fact that two people from the same
camera view should not match, to narrow the solution space to a small feasible
region. The 2D human poses used in clustering are obtained through a
pre-trained 2D pose detector, so our method does not require expensive 3D
training data for each new scene. We extensively evaluate our method on three
open datasets and two indoor and outdoor datasets collected using arbitrarily
set cameras. Our method outperforms other methods by a large margin on
cross-view person matching, reaches SOTA performance on 3D human pose
estimation without using either camera poses or 3D training data, and shows
good generalization ability across five datasets of various environment
settings.

通过将跨视图人物匹配视为一个聚类问题，利用人物匹配获得对应关系，通过多视图三角测量和束调整估计三维人体姿势，本方法在无需相机位置和三维训练数据的情况下，优于其他方法对跨视角人物匹配，在三维人体姿势估计方面达到了目前技术水平，并在不同环境设置的五个数据集上展现了良好的泛化能力。