Recent progress in Reinforcement Learning (RL), fueled by its combination,
with Deep Learning has enabled impressive results in learning to interact with
complex virtual environments, yet real-world applications of RL are still
scarce. A key limitation is data efficiency, with current state-of-the-art
approaches requiring millions of training samples. A promising way to tackle
this problem is to augment RL with learning from human demonstrations. However,
human demonstration data is not yet readily available. This hinders progress in
this direction. The present work addresses this problem as follows. We (i)
collect and describe a large dataset of human Atari 2600 replays -- the largest
and most diverse such data set publicly released to date, (ii) illustrate an
example use of this dataset by analyzing the relation between demonstration
quality and imitation learning performance, and (iii) outline possible research
directions that are opened up by our work.

本文提出了一种减少数据使用量的方法，即利用人类示范数据对强化学习模型进行训练，在此基础上，作者基于 Atari 2600 回放数据集，发现示范数据的质量和模型的模仿学习性能之间有着密切关联，为进一步拓展该方法提供了研究方向。