Large language models (LLMs) have rapidly improved text embeddings for a
growing array of natural-language processing tasks. However, their opaqueness
and proliferation into scientific domains such as neuroscience have created a
growing need for interpretability. Here, we ask whether we can obtain
interpretable embeddings through LLM prompting. We introduce question-answering
embeddings (QA-Emb), embeddings where each feature represents an answer to a
yes/no question asked to an LLM. Training QA-Emb reduces to selecting a set of
underlying questions rather than learning model weights.
We use QA-Emb to flexibly generate interpretable models for predicting fMRI
voxel responses to language stimuli. QA-Emb significantly outperforms an
established interpretable baseline, and does so while requiring very few
questions. This paves the way towards building flexible feature spaces that can
concretize and evaluate our understanding of semantic brain representations. We
additionally find that QA-Emb can be effectively approximated with an efficient
model, and we explore broader applications in simple NLP tasks.

通过利用大型语言模型（LLMs）生成的问答嵌入向量（QA-Emb）可以灵活生成可解释的用于预测 fMRI 核心响应的模型，从而深入评估我们对语义性大脑表示的理解。