The emergence of diffusion models has greatly broadened the scope of
high-fidelity image synthesis, resulting in notable advancements in both
practical implementation and academic research. With the active adoption of the
model in various real-world applications, the need for on-device deployment has
grown considerably. However, deploying large diffusion models such as Stable
Diffusion with more than one billion parameters to mobile devices poses
distinctive challenges due to the limited computational and memory resources,
which may vary according to the device. In this paper, we present the
challenges and solutions for deploying Stable Diffusion on mobile devices with
TensorFlow Lite framework, which supports both iOS and Android devices. The
resulting Mobile Stable Diffusion achieves the inference latency of smaller
than 7 seconds for a 512x512 image generation on Android devices with mobile
GPUs.

本文介绍了基于 TensorFlow Lite 部署 Diffusion 模型的挑战和解决方案，并展示了使用 Mobile Stable Diffusion 在 Android 设备上生成 512x512 图像所需的推理延迟小于 7 秒。