We present STAR, a text-to-image model that employs scale-wise
auto-regressive paradigm. Unlike VAR, which is limited to class-conditioned
synthesis within a fixed set of predetermined categories, our STAR enables
text-driven open-set generation through three key designs: To boost diversity
and generalizability with unseen combinations of objects and concepts, we
introduce a pre-trained text encoder to extract representations for textual
constraints, which we then use as guidance. To improve the interactions between
generated images and fine-grained textual guidance, making results more
controllable, additional cross-attention layers are incorporated at each scale.
Given the natural structure correlation across different scales, we leverage 2D
Rotary Positional Encoding (RoPE) and tweak it into a normalized version. This
ensures consistent interpretation of relative positions across token maps at
different scales and stabilizes the training process. Extensive experiments
demonstrate that STAR surpasses existing benchmarks in terms of fidelity,image
text consistency, and aesthetic quality. Our findings emphasize the potential
of auto-regressive methods in the field of high-quality image synthesis,
offering promising new directions for the T2I field currently dominated by
diffusion methods.

STAR 是一种文本到图像模型，通过采用自回归范式实现，并通过预训练文本编码器提取文本约束的表示，利用交叉注意力层提高生成图像与文本指导的交互作用，借助 2D RoPE 和归一化版本，确保不同尺度上的相对位置的一致解释，并通过超过现有基准的实验结果，展示其在高质量图像合成方面的潜力，为当前由扩散方法主导的 T2I 领域提供有希望的新方向。