BriefGPT.xyz
Nov, 2022
Tri-Attention:自然语言处理中的显式上下文感知注意机制
Tri-Attention: Explicit Context-Aware Attention Mechanism for Natural Language Processing
HTML
PDF
Rui Yu, Yifeng Li, Wenpeng Lu, Longbing Cao
TL;DR
该研究提出了一种新的三元注意力机制来更好地捕捉自然语言处理中的上下文信息并在三个NLP任务中实现了比30种非注意、标准Bi-Attention、上下文Bi-Attention方法和预训练神经语言模型更好的效果。
Abstract
In
natural language processing
(NLP), the context of a word or sentence plays an essential role.
contextual information
such as the semantic representation of a passage or historical dialogue forms an essential p
→