Generative artificial intelligence (AI) is interacting with people at an
unprecedented scale, offering new avenues for immense positive impact, but also
raising widespread concerns around the potential for individual and societal
harm. Today, the predominant paradigm for human-AI safety focuses on
fine-tuning the generative model's outputs to better agree with human-provided
examples or feedback. In reality, however, the consequences of an AI model's
outputs cannot be determined in an isolated context: they are tightly entangled
with the responses and behavior of human users over time. In this position
paper, we argue that meaningful safety assurances for these AI technologies can
only be achieved by reasoning about how the feedback loop formed by the AI's
outputs and human behavior may drive the interaction towards different
outcomes. To this end, we envision a high-value window of opportunity to bridge
the rapidly growing capabilities of generative AI and the dynamical safety
frameworks from control theory, laying a new foundation for human-centered AI
safety in the coming decades.

泛人工智能与人类的互动达到了前所未有的规模，为巨大的积极影响提供了新途径，但也引发了广泛关注，担忧其对个体和社会可能造成的伤害。本文中，我们认为，对这些人工智能技术的有意义的安全保证只能通过思考人工智能输出与人类行为之间形成的反馈循环如何推动交互走向不同结果来实现。为此，我们设想了从控制论到人类中心的人工智能安全的快速增长能力之间的高价值契机，为未来几十年的人类中心人工智能安全奠定了新基础。