Stochastic optimal control, which has the goal of driving the behavior of
noisy systems, is broadly applicable in science, engineering and artificial
intelligence. Our work introduces Stochastic Optimal Control Matching (SOCM), a
novel Iterative Diffusion Optimization (IDO) technique for stochastic optimal
control that stems from the same philosophy as the conditional score matching
loss for diffusion models. That is, the control is learned via a least squares
problem by trying to fit a matching vector field. The training loss, which is
closely connected to the cross-entropy loss, is optimized with respect to both
the control function and a family of reparameterization matrices which appear
in the matching vector field. The optimization with respect to the
reparameterization matrices aims at minimizing the variance of the matching
vector field. Experimentally, our algorithm achieves lower error than all the
existing IDO techniques for stochastic optimal control for four different
control settings. The key idea underlying SOCM is the path-wise
reparameterization trick, a novel technique that is of independent interest,
e.g., for generative modeling.

我们的研究引入了随机最优控制匹配（SOCM），一种基于迭代扩散优化（IDO）技术的随机最优控制方法，具有比现有方法更低的误差，并使用了路径重参数化技巧。