We study recovering fluid density and velocity from sparse multiview videos.
Existing neural dynamic reconstruction methods predominantly rely on optical
flows; therefore, they cannot accurately estimate the density and uncover the
underlying velocity due to the inherent visual ambiguities of fluid velocity,
as fluids are often shapeless and lack stable visual features. The challenge is
further pronounced by the turbulent nature of fluid flows, which calls for
properly designed fluid velocity representations. To address these challenges,
we propose hybrid neural fluid fields (HyFluid), a neural approach to jointly
infer fluid density and velocity fields. Specifically, to deal with visual
ambiguities of fluid velocity, we introduce a set of physics-based losses that
enforce inferring a physically plausible velocity field, which is
divergence-free and drives the transport of density. To deal with the turbulent
nature of fluid velocity, we design a hybrid neural velocity representation
that includes a base neural velocity field that captures most irrotational
energy and a vortex particle-based velocity that models residual turbulent
velocity. We show that our method enables recovering vortical flow details. Our
approach opens up possibilities for various learning and reconstruction
applications centered around 3D incompressible flow, including fluid
re-simulation and editing, future prediction, and neural dynamic scene
composition. Project website: this https URL

我们提出了混合神经流体场（HyFluid）的神经方法，用于联合推断流体密度和速度场，以解决流体速度的视觉模糊性和湍流性所带来的挑战，并展示了该方法在恢复涡旋流细节方面的成功，为涉及三维不可压缩流体的各种学习和重建应用打开了可能性。