Diffusion models have demonstrated remarkable performance in image and video
synthesis. However, scaling them to high-resolution inputs is challenging and
requires restructuring the diffusion pipeline into multiple independent
components, limiting scalability and complicating downstream applications. This
makes it very efficient during training and unlocks end-to-end optimization on
high-resolution videos. We improve PDMs in two principled ways. First, to
enforce consistency between patches, we develop deep context fusion -- an
architectural technique that propagates the context information from low-scale
to high-scale patches in a hierarchical manner. Second, to accelerate training
and inference, we propose adaptive computation, which allocates more network
capacity and computation towards coarse image details. The resulting model sets
a new state-of-the-art FVD score of 66.32 and Inception Score of 87.68 in
class-conditional video generation on UCF-101 $256^2$, surpassing recent
methods by more than 100%. Then, we show that it can be rapidly fine-tuned from
a base $36\times 64$ low-resolution generator for high-resolution $64 \times
288 \times 512$ text-to-video synthesis. To the best of our knowledge, our
model is the first diffusion-based architecture which is trained on such high
resolutions entirely end-to-end. Project webpage:
this https URL

扩散模型在图像和视频合成方面表现出了卓越的性能，但将其扩展到高分辨率输入是具有挑战性的，并且需要将扩散流程重组为多个独立组件，限制了可伸缩性并复杂化了下游应用。

高分辨率视频生成的分层补丁扩散模型

Hierarchical Patch Diffusion Models for High-Resolution Video Generation

Diffusion models are the main driver of progress in image and video
synthesis, but suffer from slow inference speed. Distillation methods, like the
recently introduced adversarial diffusion distillation (ADD) aim to shift the
model from many-shot to single-step inference, albeit at the cost of expensive
and difficult optimization due to its reliance on a fixed pretrained DINOv2
discriminator. We introduce Latent Adversarial Diffusion Distillation (LADD), a
novel distillation approach overcoming the limitations of ADD. In contrast to
pixel-based ADD, LADD utilizes generative features from pretrained latent
diffusion models. This approach simplifies training and enhances performance,
enabling high-resolution multi-aspect ratio image synthesis. We apply LADD to
Stable Diffusion 3 (8B) to obtain SD3-Turbo, a fast model that matches the
performance of state-of-the-art text-to-image generators using only four
unguided sampling steps. Moreover, we systematically investigate its scaling
behavior and demonstrate LADD's effectiveness in various applications such as
image editing and inpainting.

通过利用预训练的潜在扩散模型的生成特征，我们引入了一种名为 LADD 的新的蒸馏方法，它简化了训练并提高了性能，实现了高分辨率的多纵横比图像合成。我们将 LADD 应用于 Stable Diffusion 3 (8B) 以获得 SD3-Turbo，这是一个快速模型，仅使用四个无导向采样步骤就能达到与现有技术文本到图像生成器相当的性能。此外，我们还系统地研究了其扩展行为，并展示了 LADD 在图像编辑和修复等各种应用中的有效性。

快速高分辨率图像合成与潜在敌对扩散蒸馏

Fast High-Resolution Image Synthesis with Latent Adversarial Diffusion  Distillation

The generative adversarial network (GAN) framework has emerged as a powerful
tool for various image and video synthesis tasks, allowing the synthesis of
visual content in an unconditional or input-conditional manner. It has enabled
the generation of high-resolution photorealistic images and videos, a task that
was challenging or impossible with prior methods. It has also led to the
creation of many new applications in content creation. In this paper, we
provide an overview of GANs with a special focus on algorithms and applications
for visual synthesis. We cover several important techniques to stabilize GAN
training, which has a reputation for being notoriously difficult. We also
discuss its applications to image translation, image processing, video
synthesis, and neural rendering.

本文文献是关于生成对抗网络（GAN）框架及其在视觉合成领域的应用和算法进行概述，包括图像翻译、处理、合成高分辨率照片等，并讨论其在内容创作中的应用。