Relation extraction is used to populate knowledge bases that are important to
many applications. Prior datasets used to train relation extraction models
either suffer from noisy labels due to distant supervision, are limited to
certain domains or are too small to train high-capacity models. This constrains
downstream applications of relation extraction. We therefore introduce: WebRED
(Web Relation Extraction Dataset), a strongly-supervised human annotated
dataset for extracting relationships from a variety of text found on the World
Wide Web, consisting of ~110K examples. We also describe the methods we used to
collect ~200M examples as pre-training data for this task. We show that
combining pre-training on a large weakly supervised dataset with fine-tuning on
a small strongly-supervised dataset leads to better relation extraction
performance. We provide baselines for this new dataset and present a case for
the importance of human annotation in improving the performance of relation
extraction from text found on the web.

本文介绍了 WebRED (Web Relation Extraction Dataset)，这是一个由人类标注的数据集，用于从万维网上的各种文本中提取关系，并利用～200M 的预训练数据和微调技术在此任务上取得更好的表现。作者提供了该数据集的基线，并阐述了人工注释在改善从网络文本中提取关系的性能方面的重要性。