Designing Reinforcement Learning (RL) solutions for real-life problems
remains a significant challenge. A major area of concern is safety. "Shielding"
is a popular technique to enforce safety in RL by turning user-defined safety
specifications into safe agent behavior. However, these methods either suffer
from extreme learning delays, demand extensive human effort in designing models
and safe domains in the problem, or require pre-computation. In this paper, we
propose a new permissibility-based framework to deal with safety and shield
construction. Permissibility was originally designed for eliminating
(non-permissible) actions that will not lead to an optimal solution to improve
RL training efficiency. This paper shows that safety can be naturally
incorporated into this framework, i.e. extending permissibility to include
safety, and thereby we can achieve both safety and improved efficiency.
Experimental evaluation using three standard RL applications shows the
effectiveness of the approach.

在这篇论文中，我们提出了一种基于许可性的框架，用于处理安全性和屏蔽构建，并展示了其在三个标准强化学习应用中的有效性。