We consider the problem of anomaly detection with a small set of partially
labeled anomaly examples and a large-scale unlabeled dataset. This is a common
scenario in many important applications. Existing related methods either
exclusively fit the limited anomaly examples that typically do not span the
entire set of anomalies, or proceed with unsupervised learning from the
unlabeled data. We propose here instead a deep reinforcement learning-based
approach that enables an end-to-end optimization of the detection of both
labeled and unlabeled anomalies. This approach learns the known abnormality by
automatically interacting with an anomaly-biased simulation environment, while
continuously extending the learned abnormality to novel classes of anomaly
(i.e., unknown anomalies) by actively exploring possible anomalies in the
unlabeled data. This is achieved by jointly optimizing the exploitation of the
small labeled anomaly data and the exploration of the rare unlabeled anomalies.
Extensive experiments on 48 real-world datasets show that our model
significantly outperforms five state-of-the-art competing methods.

该论文提出了一个基于深度强化学习的方法来解决在只有有限的异常样本和大量无标注数据集的情况下进行异常检测的问题，该方法在自动交互式模拟环境中学习已知异常，并通过探索从而将学习到的异常扩展到未知异常，最终取得了比五种已有方法更好的实验效果。