Object-based factorizations provide a useful level of abstraction for
interacting with the world. Building explicit object representations, however,
often requires supervisory signals that are difficult to obtain in practice. We
present a paradigm for learning object-centric representations for physical
scene understanding without direct supervision of object properties. Our model,
Object-Oriented Prediction and Planning (O2P2), jointly learns a perception
function to map from image observations to object representations, a pairwise
physics interaction function to predict the time evolution of a collection of
objects, and a rendering function to map objects back to pixels. For
evaluation, we consider not only the accuracy of the physical predictions of
the model, but also its utility for downstream tasks that require an actionable
representation of intuitive physics. After training our model on an image
prediction task, we can use its learned representations to build block towers
more complicated than those observed during training.

本研究提出了一种无需直接监督对象属性即可实现学习物理场景的物体中心表征的方法，我们的模型通过联合学习感知函数，物理交互函数和渲染函数，可以精确地预测物理变化并具有可操作性的直观物理表现。