The remarkable athletic intelligence displayed by humans in complex dynamic movements such as dancing and gymnastics suggests that the balance mechanism in biological beings is decoupled from specific movement patterns. This decoupling allows for the execution of both learned and unlearned movements under certain constraints while maintaining balance through minor whole-body coordination. To replicate this balance ability and body agility, this paper proposes a versatile controller for bipedal robots. This controller achieves ankle and body trajectory tracking across a wide range of gaits using a single small-scale neural network, which is based on a model-based IK solver and reinforcement learning. We consider a single step as the smallest control unit and design a universally applicable control input form suitable for any single-step variation. Highly flexible gait control can be achieved by combining these minimal control units with high-level policy through our extensible control interface. To enhance the trajectory-tracking capability of our controller, we utilize a three-stage training curriculum. After training, the robot can move freely between target footholds at varying distances and heights. The robot can also maintain static balance without repeated stepping to adjust posture. Finally, we evaluate the tracking accuracy of our controller on various bipedal tasks, and the effectiveness of our control framework is verified in the simulation environment.

基于模型基础的逆运动学求解器和强化学习，本文提出一种适用于双足机器人的多功能控制器，通过单一小型神经网络实现了踝关节和身体轨迹跟踪，能够在广泛的步态范围内完成这一任务。通过最小控制单元结合高级策略，可以实现高度灵活的步态控制，训练后的机器人能够自由地在不同距离和高度的目标支撑点之间移动，并且能够在维持静态平衡时调整姿势。实验结果证明了我们控制框架的有效性。

基于强化学习的敏捷多功能双足机器人跟踪控制