Real-world data usually exhibits a long-tailed distribution,with a few
frequent labels and a lot of few-shot labels. The study of institution name
normalization is a perfect application case showing this phenomenon. There are
many institutions worldwide with enormous variations of their names in the
publicly available literature. In this work, we first collect a large-scale
institution name normalization dataset LoT-insts1, which contains over 25k
classes that exhibit a naturally long-tailed distribution. In order to isolate
the few-shot and zero-shot learning scenarios from the massive many-shot
classes, we construct our test set from four different subsets: many-, medium-,
and few-shot sets, as well as a zero-shot open set. We also replicate several
important baseline methods on our data, covering a wide range from search-based
methods to neural network methods that use the pretrained BERT model. Further,
we propose our specially pretrained, BERT-based model that shows better
out-of-distribution generalization on few-shot and zero-shot test sets.
Compared to other datasets focusing on the long-tailed phenomenon, our dataset
has one order of magnitude more training data than the largest existing
long-tailed datasets and is naturally long-tailed rather than manually
synthesized. We believe it provides an important and different scenario to
study this problem. To our best knowledge, this is the first natural language
dataset that focuses on long-tailed and open-set classification problems.

本文研究机构名称的规范化问题，针对实际数据应用中存在的长尾分布情况，提出了一个包含超过 25k 类的长尾数据集 LoT-insts1，并进行了基于搜索方法和 Bert 模型的神经网络等多种方法的基准测试及提出了一种特殊的 Bert 模型，在 few-shot 和 zero-shot 测试集上表现更好。该数据集是自然长尾且包含许多训练数据，是第一个专注于长尾和开放式分类问题的自然语言数据集。