Human hands possess the dexterity to interact with diverse objects such as
grasping specific parts of the objects and/or approaching them from desired
directions. More importantly, humans can grasp objects of any shape without
object-specific skills. Recent works synthesize grasping motions following
single objectives such as a desired approach heading direction or a grasping
area. Moreover, they usually rely on expensive 3D hand-object data during
training and inference, which limits their capability to synthesize grasping
motions for unseen objects at scale. In this paper, we unify the generation of
hand-object grasping motions across multiple motion objectives, diverse object
shapes and dexterous hand morphologies in a policy learning framework GraspXL.
The objectives are composed of the graspable area, heading direction during
approach, wrist rotation, and hand position. Without requiring any 3D
hand-object interaction data, our policy trained with 58 objects can robustly
synthesize diverse grasping motions for more than 500k unseen objects with a
success rate of 82.2%. At the same time, the policy adheres to objectives,
which enables the generation of diverse grasps per object. Moreover, we show
that our framework can be deployed to different dexterous hands and work with
reconstructed or generated objects. We quantitatively and qualitatively
evaluate our method to show the efficacy of our approach. Our model and code
will be available.

我们提出了一种无需 3D 手物体交互数据的策略学习框架 GraspXL，通过统一多种运动目标、多样化的物体形状和灵巧的手形态，可以可靠地合成多样化的抓取运动，且能够在超过 500,000 个未知物体中的 82.2% 上成功。