The correspondence between input text and the generated image exhibits
opacity, wherein minor textual modifications can induce substantial deviations
in the generated image. While, text embedding, as the pivotal intermediary
between text and images, remains relatively underexplored. In this paper, we
address this research gap by delving into the text embedding space, unleashing
its capacity for controllable image editing and explicable semantic direction
attributes within a learning-free framework. Specifically, we identify two
critical insights regarding the importance of per-word embedding and their
contextual correlations within text embedding, providing instructive principles
for learning-free image editing. Additionally, we find that text embedding
inherently possesses diverse semantic potentials, and further reveal this
property through the lens of singular value decomposition (SVD). These
uncovered properties offer practical utility for image editing and semantic
discovery. More importantly, we expect the in-depth analyses and findings of
the text embedding can enhance the understanding of text-to-image diffusion
models.

本文研究了文本嵌入空间，发现每个词的嵌入和其上下文相关性对学习无关的图像编辑具有重要意义，并揭示文本嵌入本身具有多样的语义潜力，通过奇异值分解来进一步揭示这一特性，这些发现对图像编辑和语义发现具有实际应用价值。