In order to build agents with a rich understanding of their environment, one
key objective is to endow them with a grasp of intuitive physics; an ability to
reason about three-dimensional objects, their dynamic interactions, and
responses to forces. While some work on this problem has taken the approach of
building in components such as ready-made physics engines, other research aims
to extract general physical concepts directly from sensory data. In the latter
case, one challenge that arises is evaluating the learning system. Research on
intuitive physics knowledge in children has long employed a violation of
expectations (VOE) method to assess children's mastery of specific physical
concepts. We take the novel step of applying this method to artificial learning
systems. In addition to introducing the VOE technique, we describe a set of
probe datasets inspired by classic test stimuli from developmental psychology.
We test a baseline deep learning system on this battery, as well as on a
physics learning dataset ("IntPhys") recently posed by another research group.
Our results show how the VOE technique may provide a useful tool for tracking
physics knowledge in future research.

本研究使用违反期望的技术（VOE）将儿童物理学习知识测试方法应用于人工深度学习系统，探讨相关图像化物理概念从感官数据中提取的方法，并介绍了一个受发展心理学启发的探测数据集。结果表明 VOE 技术可以为未来的物理学知识研究提供有用的工具。