Faced with complex problems, the human brain demonstrates a remarkable
capacity to transcend sensory input and form latent understandings of perceived
world patterns. However, this cognitive capacity is not explicitly considered
or encoded in current large language models (LLMs). As a result, LLMs often
struggle to capture latent structures and model uncertainty in complex
compositional reasoning tasks. This work introduces a novel Bayesian prompting
approach that facilitates training-free Bayesian inference with LLMs by using a
verbalized Probabilistic Graphical Model (PGM). While traditional Bayesian
approaches typically depend on extensive data and predetermined mathematical
structures for learning latent factors and dependencies, our approach
efficiently reasons latent variables and their probabilistic dependencies by
prompting LLMs to adhere to Bayesian principles. We evaluated our model on
several compositional reasoning tasks, both close-ended and open-ended. Our
results indicate that the model effectively enhances confidence elicitation and
text generation quality, demonstrating its potential to improve AI language
understanding systems, especially in modeling uncertainty.

本文介绍了一种新颖的贝叶斯提示方法，通过使用一个语言大模型（LLMs）中的一个模糊概率图模型（PGM）来实现无需训练的贝叶斯推理。我们的模型在多个组合推理任务中取得了良好的效果，有效提升了置信度的引发和文本生成质量，显示出在模拟不确定性方面提高人工智能语言理解系统的潜力。