While Language Agents have achieved promising success by placing Large
Language Models at the core of a more versatile design that dynamically
interacts with the external world, the existing approaches neglect the notion
of uncertainty during these interactions. We present the Uncertainty-Aware
Language Agent (UALA), a framework that orchestrates the interaction between
the agent and the external world using uncertainty quantification. Compared
with other well-known counterparts like ReAct, our extensive experiments across
3 representative tasks (HotpotQA, StrategyQA, MMLU) and various LLM sizes
demonstrates that UALA brings a significant improvement of performance, while
having a substantially lower reliance on the external world (i.e., reduced
number of tool calls and tokens). Our analyses provide various insights
including the great potential of UALA compared with agent fine-tuning, and
underscoring the unreliably of verbalised confidence of LLMs as a proxy for
uncertainty.

这篇研究论文介绍了一种名为 “不确定性感知的语言代理（UALA）” 的框架，它通过不确定性量化来协调代理与外界的交互，并通过对比实验证明了其在性能上的显著改进，同时对外部世界的依赖较低，也强调了语言模型的口头置信对不确定性的代理不可靠性。