We present a simple and effective method for 3D hand pose estimation from a
single depth frame. As opposed to previous state-of-the-art methods based on
holistic 3D regression, our method works on dense pixel-wise estimation. This
is achieved by careful design choices in pose parameterization, which leverages
both 2D and 3D properties of depth map. Specifically, we decompose the pose
parameters into a set of per-pixel estimations, i.e., 2D heat maps, 3D heat
maps and unit 3D directional vector fields. The 2D/3D joint heat maps and 3D
joint offsets are estimated via multi-task network cascades, which is trained
end-to-end. The pixel-wise estimations can be directly translated into a vote
casting scheme. A variant of mean shift is then used to aggregate local votes
while enforcing consensus between the the estimated 3D pose and the pixel-wise
2D and 3D estimations by design. Our method is efficient and highly accurate.
On MSRA and NYU hand dataset, our method outperforms all previous
state-of-the-art approaches by a large margin. On the ICVL hand dataset, our
method achieves similar accuracy compared to the currently proposed nearly
saturated result and outperforms various other proposed methods. Code is
available $\href{"this https URL"}{\text{online}}$.

该研究提出了一种基于单个深度帧的三维手部姿态估计方法，通过像素级别的估计实现高效准确地实现骨架姿态估计，并在 MSRA 和 NYU 手部数据集上，其方法实现了最好的性能。