Large Language Models (LLMs) have shown exceptional results on current
benchmarks when working individually. The advancement in their capabilities,
along with a reduction in parameter size and inference times, has facilitated
the use of these models as agents, enabling interactions among multiple models
to execute complex tasks. Such collaborations offer several advantages,
including the use of specialized models (e.g. coding), improved confidence
through multiple computations, and enhanced divergent thinking, leading to more
diverse outputs. Thus, the collaborative use of language models is expected to
grow significantly in the coming years. In this work, we evaluate the behavior
of a network of models collaborating through debate under the influence of an
adversary. We introduce pertinent metrics to assess the adversary's
effectiveness, focusing on system accuracy and model agreement. Our findings
highlight the importance of a model's persuasive ability in influencing others.
Additionally, we explore inference-time methods to generate more compelling
arguments and evaluate the potential of prompt-based mitigation as a defensive
strategy.

评估模型网络在对抗影响下通过辩论进行合作时的行为，探索推理时间方法生成更令人信服的论点，并评估基于提示的缓解作为一种防御策略的潜力。