We investigate the choice patterns of Large Language Models (LLMs) in the context of Decisions from Experience tasks that involve repeated choice and learning from feedback, and compare their behavior to human participants. We find that on the aggregate, LLMs appear to display behavioral biases similar to humans: both exhibit underweighting rare events and correlation effects. However, more nuanced analyses of the choice patterns reveal that this happens for very different reasons. LLMs exhibit strong recency biases, unlike humans, who appear to respond in more sophisticated ways. While these different processes may lead to similar behavior on average, choice patterns contingent on recent events differ vastly between the two groups. Specifically, phenomena such as ``surprise triggers change" and the ``wavy recency effect of rare events" are robustly observed in humans, but entirely absent in LLMs. Our findings provide insights into the limitations of using LLMs to simulate and predict humans in learning environments and highlight the need for refined analyses of their behavior when investigating whether they replicate human decision making tendencies.

本研究探讨大型语言模型（LLMs）在经验决策任务中的选择模式，发现它们的行为偏见与人类相似，但产生原因却大相径庭。与人类不同，LLMs表现出强烈的近因偏见，而人类的反应方式则更为复杂，研究结果强调了在学习环境中使用LLMs模拟人类决策的局限性，并呼吁对其行为进行更细致的分析。

大型语言模型展现人类偏见但表现出不同的学习模式