BriefGPT.xyz
Oct, 2023
关于句子嵌入的维度
On the Dimensionality of Sentence Embeddings
HTML
PDF
Hongwei Wang, Hongming Zhang, Dong Yu
TL;DR
通过维度分析，我们提出了一种双步训练方法，优化编码器和池化器以减轻低维场景中的整体性能损失，从而显著提高低维句子嵌入的性能。
Abstract
Learning
sentence embeddings
is a fundamental problem in natural language processing. While existing research primarily focuses on enhancing the quality of
sentence embeddings
, the exploration of sentence embeddi
→