BriefGPT.xyz
May, 2023
预训练语言模型对于领域外探测几乎完美是否需要微调?
Is Fine-tuning Needed? Pre-trained Language Models Are Near Perfect for Out-of-Domain Detection
HTML
PDF
Rheeya Uppaal, Junjie Hu, Yixuan Li
TL;DR
本研究探究了直接利用预训练语言模型进行Out-of-Distribution检测的有效性,并证明了其近乎完美的检测性能,同时揭示了Fine-tuning和其在ID精度与OOD检测性能之间的平衡作用。
Abstract
Out-of-distribution (OOD) detection is a critical task for reliable predictions over text.
fine-tuning
with
pre-trained language models
has been a de facto procedure to derive OOD detectors with respect to in-dis
→