Noisy labels are ubiquitous in real-world datasets, especially in the
large-scale ones derived from crowdsourcing and web searching. It is
challenging to train deep neural networks with noisy datasets since the
networks are prone to overfitting the noisy labels during training, resulting
in poor generalization performance. During an early learning phase, deep neural
networks have been observed to fit the clean samples before memorizing the
mislabeled samples. In this paper, we dig deeper into the representation
distributions in the early learning phase and find that, regardless of their
noisy labels, learned representations of images from the same category still
congregate together. Inspired by it, we propose a framework that trains the
model with new synthetic samples to mitigate the impact of noisy labels.
Specifically, we propose a mixing strategy to create the synthetic samples by
aggregating original samples with their top-K nearest neighbours, wherein the
weights are calculated using a mixture model learning from the per-sample loss
distribution. To enhance the performance in the presence of extreme label
noise, we estimate the soft targets by gradually correcting the noisy labels.
Furthermore, we demonstrate that the estimated soft targets yield a more
accurate approximation to ground truth labels and the proposed method produces
a superior quality of learned representations with more separated and clearly
bounded clusters. The extensive experiments in two benchmarks (CIFAR-10 and
CIFAR-100) and two larg-scale real-world datasets (Clothing1M and Webvision)
demonstrate that our approach outperforms the state-of-the-art methods and
robustness of the learned representation.

通过使用混合模型从局部损失分布学习样本权重，我们提出了一种利用合成样本训练模型的框架来减轻噪音标签影响，并通过逐渐修正噪音标签估计软目标，得到了更为准确的近似真实标签和更加独立和清晰界定的聚类，实验证明我们的方法在两个基准数据集 (CIFAR-10 和 CIFAR-100) 及两个大规模真实世界数据集 (Clothing1M 和 Webvision) 上优于现有技术方法且具备可靠的学习表达能力。