Seismic advances in generative AI algorithms for imagery, text, and other
data types has led to the temptation to use synthetic data to train
next-generation models. Repeating this process creates an autophagous
(self-consuming) loop whose properties are poorly understood. We conduct a
thorough analytical and empirical analysis using state-of-the-art generative
image models of three families of autophagous loops that differ in how fixed or
fresh real training data is available through the generations of training and
in whether the samples from previous generation models have been biased to
trade off data quality versus diversity. Our primary conclusion across all
scenarios is that without enough fresh real data in each generation of an
autophagous loop, future generative models are doomed to have their quality
(precision) or diversity (recall) progressively decrease. We term this
condition Model Autophagy Disorder (MAD), making analogy to mad cow disease.

该论文使用最先进的生成图像模型对三种不同类型的自噬循环进行了彻底的分析和实证研究，发现如果每个世代没有足够的新真实数据，未来的生成模型的质量或多样性将逐渐降低，这种情况被称为 ' 模型自噬障碍 '（MAD）。