BriefGPT.xyz
Apr, 2019
用卷积上下文来进行ASR的变压器
Transformers with convolutional context for ASR
HTML
PDF
Abdelrahman Mohamed, Dmytro Okhonko, Luke Zettlemoyer
TL;DR
本文提出了用卷积学习输入表示替换变形器的正弦位置嵌入,并阐述其在提供长程关系方面的优势和优化特点,最终实现了在无额外语言模型文本下,librispeech测试中4.7%和12.9%的字错率。
Abstract
The recent success of
transformer networks
for neural machine translation and other NLP tasks has led to a surge in research work trying to apply it for
speech recognition
. Recent efforts studied key research que
→