BriefGPT.xyz
Mar, 2020
标签平滑是否缓解标签噪声?
Does label smoothing mitigate label noise?
HTML
PDF
Michal Lukasik, Srinadh Bhojanapalli, Aditya Krishna Menon, Sanjiv Kumar
TL;DR
本文通过研究标签平滑是否能够缓解标签噪声的影响,发现标签平滑可以与标签噪声文献中的一类损失校正技术相竞争,同时发现在从嘈杂数据中提取模型时,对老师标签进行标签平滑可以提高模型性能,这对于噪声无关问题的最近发现提供了进一步的启示,说明标签平滑在某些情况下是有益的。
Abstract
label smoothing
is commonly used in training
deep learning
models, wherein one-hot training labels are mixed with uniform label vectors. Empirically, smoothing has been shown to improve both
→