Speaker adaptation is important to build robust automatic speech recognition
(ASR) systems. In this work, we investigate various methods for speaker
adaptive training (SAT) based on feature-space approaches for a conformer-based
acoustic model (AM) on the Switchboard 300h dataset. We propose a method,
called Weighted-Simple-Add, which adds weighted speaker information vectors to
the input of the multi-head self-attention module of the conformer AM. Using
this method for SAT, we achieve 3.5% and 4.5% relative improvement in terms of
WER on the CallHome part of Hub5'00 and Hub5'01 respectively. Moreover, we
build on top of our previous work where we proposed a novel and competitive
training recipe for a conformer-based hybrid AM. We extend and improve this
recipe where we achieve 11% relative improvement in terms of word-error-rate
(WER) on Switchboard 300h Hub5'00 dataset. We also make this recipe efficient
by reducing the total number of parameters by 34% relative.

本文探讨了多种说话人自适应训练的方法，提出了加权简单加法这一方法，该方法可以将权重说话人信息向量添加到自我注意模块的输入中，通过在 Switchboard 300h 数据集上的实验，证明了该方法的有效性，并在先前的工作基础上提出了一种新颖的训练配方，成功地降低了模型参数数量，并在 Switchboard 300h Hub5'00 数据集上取得了 11% 的相对错误率改进。