Modeling object dynamics with a neural network is an important problem with
numerous applications. Most recent work has been based on graph neural
networks. However, physics happens in 3D space, where geometric information
potentially plays an important role in modeling physical phenomena. In this
work, we propose a novel U-net architecture based on continuous point
convolution which naturally embeds information from 3D coordinates and allows
for multi-scale feature representations with established downsampling and
upsampling procedures. Bottleneck layers in the downsampled point clouds lead
to better long-range interaction modeling. Besides, the flexibility of point
convolutions allows our approach to generalize to sparsely sampled points from
mesh vertices and dynamically generate features on important interaction points
on mesh faces. Experimental results demonstrate that our approach significantly
improves the state-of-the-art, especially in scenarios that require accurate
gravity or collision reasoning.

基于连续点卷积的新型 U-net 架构能够自然地嵌入 3D 坐标信息，并通过已建立的下采样和上采样过程进行多尺度的特征表示，从而有效地改进了基于神经网络的三维物体动态建模方法。