Xinyu Wang, Yong Jiang, Nguyen Bach, Tao Wang, Zhongqiang Huang...
TL;DR本文提出基于神经网络结构搜索的方法 Automated Concatenation of Embeddings(ACE)去寻找拼接不同种类嵌入的最佳组合,以提高预测任务的性能,并在六种任务、21个数据集上获得了超越强基线的最优性能。
Abstract
pretrained contextualized embeddings are powerful word representations for structured prediction tasks. Recent work found that better word representations can be obtained by concatenating different types of embed