BriefGPT.xyz
Nov, 2019
从BERT中引出关系知识
Inducing Relational Knowledge from BERT
HTML
PDF
Zied Bouraoui, Jose Camacho-Collados, Steven Schockaert
TL;DR
该研究使用一种方法从预训练语言模型中提取关系知识,通过使用大量文本语料库,我们提取句子作为模板,并通过微调语言模型来预测一对词是否是某个关系的实例。
Abstract
One of the most remarkable properties of
word embeddings
is the fact that they capture certain types of semantic and syntactic relationships. Recently,
pre-trained language models
such as
→