The remarkable performance of the o1 model in complex reasoning demonstrates that test-time computing scaling can further unlock the model's potential, enabling powerful System-2 thinking. However, there is still a lack of comprehensive surveys for test-time computing scaling. We trace the concept of test-time computing back to System-1 models. In System-1 models, test-time computing addresses distribution shifts and improves robustness and generalization through parameter updating, input modification, representation editing, and output calibration. In System-2 models, it enhances the model's reasoning ability to solve complex problems through repeated sampling, self-correction, and tree search. We organize this survey according to the trend of System-1 to System-2 thinking, highlighting the key role of test-time computing in the transition from System-1 models to weak System-2 models, and then to strong System-2 models. We also point out a few possible future directions.

本文研究了测试时间计算在提升复杂推理能力中的关键作用，填补了现有研究中的空白。通过对系统-1和系统-2思维的分析，提出了一种新颖的方法来提高模型的推理能力与稳健性，并探讨了其在未来研究方向上的潜力。研究发现，测试时间计算能够有效促进模型从弱系统-2思维过渡到强系统-2思维。

测试时间计算：从系统-1思维到系统-2思维