This paper introduces the innovative "LLMs-as-Instructors" framework, which
leverages the advanced Large Language Models (LLMs) to autonomously enhance the
training of smaller target models. Inspired by the theory of "Learning from
Errors", this framework employs an instructor LLM to meticulously analyze the
specific errors within a target model, facilitating targeted and efficient
training cycles. Within this framework, we implement two strategies: "Learning
from Error," which focuses solely on incorrect responses to tailor training
data, and "Learning from Error by Contrast", which uses contrastive learning to
analyze both correct and incorrect responses for a deeper understanding of
errors.
Our empirical studies, conducted with several open-source models, demonstrate
significant improvements across multiple benchmarks, including mathematical
reasoning, coding abilities, and factual knowledge. Notably, the refined
Llama-3-8b-Instruction has outperformed ChatGPT, illustrating the effectiveness
of our approach. By leveraging the strengths of both strategies, we have
attained a more balanced performance improvement on both in-domain and
out-of-domain benchmarks. Our code can be found at
this https URL

该研究介绍了创新的 “LLMs 作为教师” 的框架，利用先进的大型语言模型（LLMs）自动增强较小目标模型的训练。采用 “学习错误” 理论启发，该框架使用教师 LLM 细致分析目标模型中的具体错误，促进有针对性和高效的训练周期。通过 “学习错误” 和 “对比学习从错误中学习”，该框架实施了两种策略，分别关注错误响应以个性化训练数据，并分析正确和错误响应以更深入理解错误。使用多个开源模型进行的实证研究表明，在数理推理、编码能力和事实知识等多个基准测试中都取得了显著的改进。值得注意的是，改进后的 Llama-3-8b-Instruction 的表现超过了 ChatGPT，证明了我们方法的有效性。通过充分利用两种策略的优势，我们在领域内外基准测试上获得了更加平衡的性能提升。我们的代码可在此 https URL 找到。

基于错误学习的 LLM 教学：自动化模型改进

LLMs-as-Instructors: Learning from Errors Toward Automating Model  Improvement

Membership Inference Attacks (MIAs) infer whether a data point is in the
training data of a machine learning model. It is a threat while being in the
training data is private information of a data point. MIA correctly infers some
data points as members or non-members of the training data. Intuitively, data
points that MIA accurately detects are vulnerable. Considering those data
points may exist in different target models susceptible to multiple MIAs, the
vulnerability of data points under multiple MIAs and target models is worth
exploring.
This paper defines new metrics that can reflect the actual situation of data
points' vulnerability and capture vulnerable data points under multiple MIAs
and target models. From the analysis, MIA has an inference tendency to some
data points despite a low overall inference performance. Additionally, we
implement 54 MIAs, whose average attack accuracy ranges from 0.5 to 0.9, to
support our analysis with our scalable and flexible platform, Membership
Inference Attacks Platform (VMIAP). Furthermore, previous methods are
unsuitable for finding vulnerable data points under multiple MIAs and different
target models. Finally, we observe that the vulnerability is not characteristic
of the data point but related to the MIA and target model.

本文通过定义新的指标来反映数据点在多重成员推断攻击下的脆弱性，从而捕捉多次攻击和不同目标模型下的脆弱数据点。作者运用可扩展性和灵活性的会员推断攻击平台 (VMIAP) 实现 54 次成员推断攻击，发现攻击模型对某些数据点情有独钟，同时发现数据点的脆弱性与攻击模型和目标模型有关。