Labeling errors in datasets are common, if not systematic, in practice. They
naturally arise in a variety of contexts-human labeling, noisy labeling, and
weak labeling (i.e., image classification), for example. This presents a
persistent and pervasive stress on machine learning practice. In particular,
neural network (NN) architectures can withstand minor amounts of dataset
imperfection with traditional countermeasures such as regularization, data
augmentation, and batch normalization. However, major dataset imperfections
often prove insurmountable. We propose and study the implementation of
Rockafellian Relaxation (RR), a new loss reweighting, architecture-independent
methodology, for neural network training. Experiments indicate RR can enhance
standard neural network methods to achieve robust performance across
classification tasks in computer vision and natural language processing
(sentiment analysis). We find that RR can mitigate the effects of dataset
corruption due to both (heavy) labeling error and/or adversarial perturbation,
demonstrating effectiveness across a variety of data domains and machine
learning tasks.

通过 Rockafellian Relaxation（RR）方法，研究证明可以增强传统神经网络方法，实现在计算机视觉和自然语言处理（情感分析）等分类任务中的鲁棒性能，从而减轻由数据标记错误和 / 或对抗扰动引起的数据污染的影响。