Standard stochastic control methods assume that the probability distribution
of uncertain variables is available. Unfortunately, in practice, obtaining
accurate distribution information is a challenging task. To resolve this issue,
we investigate the problem of designing a control policy that is robust against
errors in the empirical distribution obtained from data. This problem can be
formulated as a two-player zero-sum dynamic game problem, where the action
space of the adversarial player is a Wasserstein ball centered at the empirical
distribution. We propose computationally tractable value and policy iteration
algorithms with explicit estimates of the number of iterations required for
constructing an $\epsilon$-optimal policy. We show that the contraction
property of associated Bellman operators extends a single-stage out-of-sample
performance guarantee, obtained using a measure concentration inequality, to
the corresponding multi-stage guarantee without any degradation in the
confidence level. In addition, we characterize an explicit form of the optimal
distributionally robust control policy and the worst-case distribution policy
for linear-quadratic problems with Wasserstein penalty. Our study indicates
that dynamic programming and Kantorovich duality play a critical role in
solving and analyzing the Wasserstein distributionally robust stochastic
control problems.

研究了一个基于 Wasserstein 分布的鲁棒控制策略问题，提出了一个可计算的值迭代算法和策略迭代算法，并通过动态规划和 Kantorovich 对偶理论的分析，在保证置信水平不降低的情况下，构造了一个多阶段性能保证和最优分布鲁棒控制策略。