One part of complying with norms, rules, and preferences is incorporating
constraints (such as knowledge of ethics) into one's goal formulation and
planning processing. We explore in a simple domain how the encoding of
knowledge in different ethical frameworks influences an agent's goal
formulation and planning processing and demonstrate ability of an agent to
satisfy and satisfice when its collection of relevant constraints includes a
mix of "hard" and "soft" constraints of various types. How the agent attempts
to comply with ethical constraints depends on the ethical framing and we
investigate tradeoffs between deontological framing and utilitarian framing for
complying with an ethical norm. Representative scenarios highlight how
performing the same task with different framings of the same norm leads to
different behaviors. Our explorations suggest an important role for
metacognitive judgments in resolving ethical conflicts during goal formulation
and planning.

在一个简单的领域中，我们探索了在不同伦理框架中知识的编码如何影响代理人的目标制定和规划过程，并展示了代理人在相关约束的集合中包含各种类型的 “硬性” 和 “软性” 约束时满足和满足的能力。我们研究了代理人如何尝试遵守伦理约束，这取决于伦理框架，并探讨了以德性导向和功利导向来遵守伦理规范之间的权衡。代表性场景突显了以不同框架对同一规范执行相同任务将导致不同行为。我们的探索表明，在目标制定和规划过程中解决伦理冲突时，元认知判断发挥重要作用。