Nowadays, large-scale foundation models are being increasingly integrated
into numerous safety-critical applications, including human-autonomy teaming
(HAT) within transportation, medical, and defence domains. Consequently, the
inherent 'black-box' nature of these sophisticated deep neural networks
heightens the significance of fostering mutual understanding and trust between
humans and autonomous systems. To tackle the transparency challenges in HAT,
this paper conducts a thoughtful study on the underexplored domain of
Explainable Interface (EI) in HAT systems from a human-centric perspective,
thereby enriching the existing body of research in Explainable Artificial
Intelligence (XAI). We explore the design, development, and evaluation of EI
within XAI-enhanced HAT systems. To do so, we first clarify the distinctions
between these concepts: EI, explanations and model explainability, aiming to
provide researchers and practitioners with a structured understanding. Second,
we contribute to a novel framework for EI, addressing the unique challenges in
HAT. Last, our summarized evaluation framework for ongoing EI offers a holistic
perspective, encompassing model performance, human-centered factors, and group
task objectives. Based on extensive surveys across XAI, HAT, psychology, and
Human-Computer Interaction (HCI), this review offers multiple novel insights
into incorporating XAI into HAT systems and outlines future directions.

本文从以人为中心的角度对人工智能可解释性界面在人工智能增强的人机协作系统中的透明性挑战进行了深入研究，并提出了一个用于评估该界面的新框架。通过在可解释人工智能、人机协作以及人机交互等领域进行广泛调查，该研究提供了多个新见解，探讨了将可解释人工智能整合到人工智能增强的人机协作系统中的未来方向。