In this paper, we formulate keyphrase extraction from scholarly articles as a
sequence labeling task solved using a BiLSTM-CRF, where the words in the input
text are represented using deep contextualized embeddings. We evaluate the
proposed architecture using both contextualized and fixed word embedding models
on three different benchmark datasets (Inspec, SemEval 2010, SemEval 2017) and
compare with existing popular unsupervised and supervised techniques. Our
results quantify the benefits of (a) using contextualized embeddings (e.g.
BERT) over fixed word embeddings (e.g. Glove); (b) using a BiLSTM-CRF
architecture with contextualized word embeddings over fine-tuning the
contextualized word embedding model directly, and (c) using genre-specific
contextualized embeddings (SciBERT). Through error analysis, we also provide
some insights into why particular models work better than others. Lastly, we
present a case study where we analyze different self-attention layers of the
two best models (BERT and SciBERT) to better understand the predictions made by
each for the task of keyphrase extraction.

本文提出了一种使用 BiLSTM-CRF 模型和深度语境化嵌入来解决学术论文关键词提取问题，结果表明使用语境化嵌入、BiLSTM-CRF 结构和针对特定类型文章的语境化嵌入可以达到更好的性能，并且我们还分析了各种模型的优劣。