The flow of ideas has been extensively studied by physicists, psychologists, and machine learning engineers. This paper adopts specific tools from microrheology to investigate the similarity-based flow of ideas. We introduce a random walker in word embeddings and study its behavior. Such similarity-mediated random walks through the embedding space show signatures of anomalous diffusion commonly observed in complex structured systems such as biological cells and complex fluids. The paper concludes by proposing the application of popular tools employed in the study of random walks and diffusion of particles under Brownian motion to assess quantitatively the incorporation of diverse ideas in a document. Overall, this paper presents a self-referenced method combining microrheology and machine learning concepts to explore the meandering tendencies of language models and their potential association with creativity.

本文采用微流变学的特定工具研究了基于相似性的思想流动，通过介绍词嵌入中的随机行走并研究其行为，发现这种相似性介导的随机行走在嵌入空间中表现出生物细胞和复杂流体等复杂结构系统中常见的异常扩散特征。最后，该论文提出了应用随机行走和布朗运动下粒子扩散的研究中常用的工具，来定量评估文档中多样思想的融入情况，总体而言，该论文提出了结合微流变学和机器学习概念的自我参照方法，以探索语言模型的蜿蜒倾向及其与创造力的潜在关联。

词嵌入中的思想流动