Probing strategies have been shown to detect the presence of various
linguistic features in large language models; in particular, semantic features
intermediate to the "natural logic" fragment of the Natural Language Inference
task (NLI). In the case of natural logic, the relation between the intermediate
features and the entailment label is explicitly known: as such, this provides a
ripe setting for interventional studies on the NLI models' representations,
allowing for stronger causal conjectures and a deeper critical analysis of
interventional probing methods. In this work, we carry out new and existing
representation-level interventions to investigate the effect of these semantic
features on NLI classification: we perform amnesic probing (which removes
features as directed by learned linear probes) and introduce the mnestic
probing variation (which forgets all dimensions except the probe-selected
ones). Furthermore, we delve into the limitations of these methods and outline
some pitfalls have been obscuring the effectivity of interventional probing
studies.

本文研究探索了在自然语言推理任务中探测语言模型中自然逻辑之外的中间语义特征的方法，通过不同的干预探测方法以及限制模型表示能力的探测方法，得出了有关 NLI 模型表示和干预探测的因果推断和分析。同时，带出了干预探测研究的一些局限性和难题。