Diffusion models can learn strong image priors from underlying data
distribution and use them to solve inverse problems, but the training process
is computationally expensive and requires lots of data. Such bottlenecks
prevent most existing works from being feasible for high-dimensional and
high-resolution data such as 3D images. This paper proposes a method to learn
an efficient data prior for the entire image by training diffusion models only
on patches of images. Specifically, we propose a patch-based position-aware
diffusion inverse solver, called PaDIS, where we obtain the score function of
the whole image through scores of patches and their positional encoding and
utilize this as the prior for solving inverse problems. First of all, we show
that this diffusion model achieves an improved memory efficiency and data
efficiency while still maintaining the capability to generate entire images via
positional encoding. Additionally, the proposed PaDIS model is highly flexible
and can be plugged in with different diffusion inverse solvers (DIS). We
demonstrate that the proposed PaDIS approach enables solving various inverse
problems in both natural and medical image domains, including CT
reconstruction, deblurring, and superresolution, given only patch-based priors.
Notably, PaDIS outperforms previous DIS methods trained on entire image priors
in the case of limited training data, demonstrating the data efficiency of our
proposed approach by learning patch-based prior.

本文提出了一种通过仅对图像的补丁进行扩散模型训练来学习整个图像的高效数据先验的方法，该方法通过分数和位置编码获取整个图像的分数函数，并将其用作解决逆问题的先验。该方法在提高内存效率和数据效率的同时，仍然能够通过位置编码生成整个图像，并且可以与不同的扩散逆求解器（DIS）配合使用，适用于自然和医学图像域中的各种逆问题解决，包括 CT 重建，去模糊和超分辨率，仅使用基于补丁的先验方法优于基于整个图像先验训练的先前 DIS 方法在训练数据有限的情况下表现出了数据效率。