In this paper, we propose a novel Siamese Adversarial Network (SAN)
architecture for automatic speech recognition, which aims at solving the
difficulty of fuzzy audio recognition. Specifically, SAN constructs two
sub-networks to differentiate the audio feature input and then introduces a
loss to unify the output distribution of these sub-networks. Adversarial
learning enables the network to capture more essential acoustic features and
helps the models achieve better performance when encountering fuzzy audio
input. We conduct numerical experiments with the SAN model on several datasets
for the automatic speech recognition task. All experimental results show that
the siamese adversarial nets significantly reduce the character error rate
(CER). Specifically, we achieve a new state of art 4.37 CER without language
model on the AISHELL-1 dataset, which leads to around 5% relative CER
reduction. To reveal the generality of the siamese adversarial net, we also
conduct experiments on the phoneme recognition task, which also shows the
superiority of the siamese adversarial network.

本研究提出一种新颖的 Siamese Adversarial Network (SAN) 结构，可以显著降低字符误差率（CER），实现了自动语音识别任务上的新突破。该网络能够捕捉到更多的声学特征，同时优化输出分布，适用于含有不清晰音频的数据集。