A recursive tree planner (RTP) is designed to function as a pure planner
without policies at one extreme and run a pure greedy policy at the other. In
between, the RTP exploits policies to improve planning performance and improve
zero-shot transfer from one class of planning problem to another. Policies are
learned through imitation of the planner. These are then used by the planner to
improve policies in a virtuous cycle. To improve planning performance and
zero-shot transfer, the RTP incorporates previously learned tasks as
generalized actions (GA) at any level of its hierarchy, and can refine those GA
by adding primitive actions at any level too. For search, the RTP uses a
generalized Dijkstra algorithm [Dijkstra 1959] which tries the greedy policy
first and then searches over near-greedy paths and then farther away as
necessary. The RPT can return multiple sub-goals from lower levels as well as
boundary states near obstacles, and can exploit policies with background and
object-number invariance. Policies at all levels of the hierarchy can be
learned simultaneously or in any order or come from outside the framework. The
RTP is tested here on a variety of Box2d [Cato 2022] problems, including the
classic lunar lander [Farama 2022], and on the MuJoCo [Todorov et al 2012]
inverted pendulum.

递归树规划（RTP）同时利用策略和贪心算法来改善规划性能和零样本迁移，使用广义 Dijkstra 算法作为搜索方法，将已学习的任务作为广义动作集合以提高规划性能，并在不同层次上添加原始动作。