Objective This study investigates the use of word embeddings and sequence features for sample representation in an active learning framework built to extract clinical concepts from clinical free text. The objective is to further reduce the manual annotation effort while achieving higher effectiveness compared to a set of baseline features. Materials and methods The comparative performance of unsupervised features and baseline hand-crafted features in an active learning framework were investigated. Unsupervised features were derived from skip-gram word embeddings and a sequence representation approach. Least confidence, information diversity, information density and diversity, and domain knowledge informativeness were used as selection criteria for active learning framework. Two clinical datasets were used for evaluation: the i2b2/VA 2010 NLP challenge and the ShARe/CLEF 2013 eHealth Evaluation Lab. Results Our results demonstrated significant improvement by adding unsupervised word and sequence level features in the active learning framework in terms of effectiveness as well as annotation effort across both datasets. Using unsupervised features along with baseline features for sample representation led to further savings of up to 10% and 6% of the token and concept annotation rates, respectively. Conclusion This study shows that the manual annotation of clinical free text for automated analysis can be accelerated by using unsupervised features for sample representation in an active learning framework. To the best of our knowledge, this is the first study to analyze the effect of unsupervised features on active learning performance in clinical information extraction.

该研究采用无监督词嵌入和序列特征来提取临床自由文本中的临床概念，通过主动学习框架来进一步减少手动注释工作量，实现了较高的有效性和标注效率节约。

使用词嵌入特征的临床信息提取主动学习的益处