Diffusion Models (DMs) utilize an iterative denoising process to transform
random noise into synthetic data. Initally proposed with a UNet structure, DMs
excel at producing images that are virtually indistinguishable with or without
conditioned text prompts. Later transformer-only structure is composed with DMs
to achieve better performance. Though Latent Diffusion Models (LDMs) reduce the
computational requirement by denoising in a latent space, it is extremely
expensive to inference images for any operating devices due to the shear volume
of parameters and feature sizes. Post Training Quantization (PTQ) offers an
immediate remedy for a smaller storage size and more memory-efficient
computation during inferencing. Prior works address PTQ of DMs on UNet
structures have addressed the challenges in calibrating parameters for both
activations and weights via moderate optimization. In this work, we pioneer an
efficient PTQ on transformer-only structure without any optimization. By
analysing challenges in quantizing activations and weights for diffusion
transformers, we propose a single-step sampling calibration on activations and
adapt group-wise quantization on weights for low-bit quantization. We
demonstrate the efficiency and effectiveness of proposed methods with
preliminary experiments on conditional image generation.

通过分析扩散变换器中激活和权重量化的挑战，我们提出了一种单步采样校准激活和适应分组量化权重的低比特量化方法，从而在无需任何优化的情况下在纯变换器结构上实现了高效的后量化，我们通过初步的条件图像生成实验展示了所提出方法的效率和有效性。