The CTC-based automatic speech recognition (ASR) models without the external
language model usually lack the capacity to model conditional dependencies and
textual interactions. In this paper, we present a Gated Interlayer
Collaboration (GIC) mechanism to improve the performance of CTC-based models,
which introduces textual information into the model and thus relaxes the
conditional independence assumption of CTC-based models. Specifically, we
consider the weighted sum of token embeddings as the textual representation for
each position, where the position-specific weights are the softmax probability
distribution constructed via inter-layer auxiliary CTC losses. The textual
representations are then fused with acoustic features by developing a gate
unit. Experiments on AISHELL-1, TEDLIUM2, and AIDATATANG corpora show that the
proposed method outperforms several strong baselines.

本文提出一种 Gated Interlayer Collaboration 机制，将文本信息引入语音识别 CTC-based models，提出了一种融合文本表示和声学特征的门单元，并在多个语料库上进行试验，结果表明该方法优于现有的多数基线模型。