Extracting keypoint locations from input hand frames, known as 3D hand pose
estimation, is a critical task in various human-computer interaction
applications. Essentially, the 3D hand pose estimation can be regarded as a 3D
point subset generative problem conditioned on input frames. Thanks to the
recent significant progress on diffusion-based generative models, hand pose
estimation can also benefit from the diffusion model to estimate keypoint
locations with high quality. However, directly deploying the existing diffusion
models to solve hand pose estimation is non-trivial, since they cannot achieve
the complex permutation mapping and precise localization. Based on this
motivation, this paper proposes HandDiff, a diffusion-based hand pose
estimation model that iteratively denoises accurate hand pose conditioned on
hand-shaped image-point clouds. In order to recover keypoint permutation and
accurate location, we further introduce joint-wise condition and local detail
condition. Experimental results demonstrate that the proposed HandDiff
significantly outperforms the existing approaches on four challenging hand pose
benchmark datasets. Codes and pre-trained models are publicly available at
this https URL

基于扩散模型，本文提出了 HandDiff，一种基于手型图像点云的迭代去噪准确手势姿态估计模型，旨在通过联合条件和局部细节条件，恢复关键点排列和准确位置，并在四个具有挑战性的手势姿态基准数据集上显著优于现有方法。