Large Language Models (LLMs) have demonstrated amazing capabilities in
language generation, text comprehension, and knowledge reasoning. While a
single powerful model can already handle multiple tasks, relying on a single
perspective can lead to biased and unstable results. Recent studies have
further improved the model's reasoning ability on a wide range of tasks by
introducing multi-model collaboration. However, models with different
capabilities may produce conflicting answers on the same problem, and how to
reasonably obtain the correct answer from multiple candidate models has become
a challenging problem. In this paper, we propose the multi-model brainstorming
based on prompt. It incorporates different models into a group for
brainstorming, and after multiple rounds of reasoning elaboration and
re-inference, a consensus answer is reached within the group. We conducted
experiments on three different types of datasets, and demonstrate that the
brainstorming can significantly improve the effectiveness in logical reasoning
and fact extraction. Furthermore, we find that two small-parameter models can
achieve accuracy approximating that of larger-parameter models through
brainstorming, which provides a new solution for distributed deployment of
LLMs.

通过多模型合作和多模型头脑风暴的方式，可以在逻辑推理和事实提取方面显著提高效果，并且发现两个小参数模型通过头脑风暴可以达到接近大参数模型的准确度，为大型语言模型的分布式部署提供了新的解决方案。