BriefGPT.xyz
Aug, 2023
从数量到质量:通过自导数据选择提高LLM性能以进行指令调整
From Quantity to Quality: Boosting LLM Performance with Self-Guided Data Selection for Instruction Tuning
HTML
PDF
Ming Li, Yong Zhang, Zhitao Li, Jiuhai Chen, Lichang Chen...
TL;DR
大型语言模型的自主选择优化方法以及通过IFD指标识别差异以提高模型训练效率的研究对于提高LLM的效率和资源利用具有重要意义。
Abstract
In the realm of
large language models
, the balance between instruction data quality and quantity has become a focal point. Recognizing this, we introduce a
self-guided methodology
for LLMs to autonomously discern
→