In this paper, we address the problem of how to robustly train a ConvNet for
regression, or deep robust regression. Traditionally, deep regression employs
the L2 loss function, known to be sensitive to outliers, i.e. samples that
either lie at an abnormal distance away from the majority of the training
samples, or that correspond to wrongly annotated targets. This means that,
during back-propagation, outliers may bias the training process due to the high
magnitude of their gradient. In this paper, we propose DeepGUM: a deep
regression model that is robust to outliers thanks to the use of a
Gaussian-uniform mixture model. We derive an optimization algorithm that
alternates between the unsupervised detection of outliers using
expectation-maximization, and the supervised training with cleaned samples
using stochastic gradient descent. DeepGUM is able to adapt to a continuously
evolving outlier distribution, avoiding to manually impose any threshold on the
proportion of outliers in the training set. Extensive experimental evaluations
on four different tasks (facial and fashion landmark detection, age and head
pose estimation) lead us to conclude that our novel robust technique provides
reliability in the presence of various types of noise and protection against a
high percentage of outliers.

本文提出了一种名为 DeepGUM 的深度回归模型，通过使用混合高斯均匀模型，它可以在训练过程中自动适应不断变化的离群点分布，从而避免使用手动阈值对训练集中的离群点进行清理。 在进行了大量实验的基础上，我们得出结论，该新的鲁棒技术可以提供可靠性，并在各种噪声类型和高比例的离群点中提供保护。