Previous works have demonstrated the effectiveness of utilising pre-trained
sentence encoders based on their sentence representations for meaning
comparison tasks. Though such representations are shown to capture hidden
syntax structures, the direct similarity comparison between them exhibits weak
sensitivity to word order and structural differences in given sentences. A
single similarity score further makes the comparison process hard to interpret.
Therefore, we here propose to combine sentence encoders with an alignment
component by representing each sentence as a list of predicate-argument spans
(where their span representations are derived from sentence encoders), and
decomposing the sentence-level meaning comparison into the alignment between
their spans for paraphrase identification tasks. Empirical results show that
the alignment component brings in both improved performance and
interpretability for various sentence encoders. After closer investigation, the
proposed approach indicates increased sensitivity to structural difference and
enhanced ability to distinguish non-paraphrases with high lexical overlap.

本文提出一种将句子编码器与对齐组件相结合的方法，针对改善意思相似度比较任务的性能和可解释性，并通过具体实验证明了该方法能够提升模型对结构差异和高词汇重复的语句的区分能力。