BriefGPT.xyz
Apr, 2021
双视角蒸馏BERT用于句子嵌入
Dual-View Distilled BERT for Sentence Embedding
HTML
PDF
Xingyi Cheng
TL;DR
本文提出了一种基于Dual-view distilled BERT~(DvBERT)的句子匹配方法，该方法能够捕捉多个角度的句子信息，进而提升表征能力，相较于state-of-the-art方法，在六个STS任务上达到了更好的效果。
Abstract
Recently,
bert
realized significant progress for
sentence matching
via word-level cross sentence attention. However, the performance significantly drops when using siamese
→