We present PhyCAGE, the first approach for physically plausible compositional 3D asset generation from a single image. Given an input image, we first generate consistent multi-view images for components of the assets. These images are then fitted with 3D Gaussian Splatting representations. To ensure that the Gaussians representing objects are physically compatible with each other, we introduce a Physical Simulation-Enhanced Score Distillation Sampling (PSE-SDS) technique to further optimize the positions of the Gaussians. It is achieved by setting the gradient of the SDS loss as the initial velocity of the physical simulation, allowing the simulator to act as a physics-guided optimizer that progressively corrects the Gaussians' positions to a physically compatible state. Experimental results demonstrate that the proposed method can generate physically plausible compositional 3D assets given a single image.

该研究解决了从单幅图像生成物理合理的组合3D资产的难题，通过生成一致的多视图图像并运用3D高斯点云表示。引入的物理仿真增强评分蒸馏采样（PSE-SDS）技术优化了高斯位置，使得生成的3D资产在物理上兼容。实验结果表明，该方法能够有效生成物理合理的3D资产。

PhyCAGE：基于单幅图像的物理合理组合3D资产生成