In this paper, we investigated a speech augmentation based unsupervised
learning approach for keyword spotting (KWS) task. KWS is a useful speech
application, yet also heavily depends on the labeled data. We designed a
CNN-Attention architecture to conduct the KWS task. CNN layers focus on the
local acoustic features, and attention layers model the long-time dependency.
To improve the robustness of KWS model, we also proposed an unsupervised
learning method. The unsupervised loss is based on the similarity between the
original and augmented speech features, as well as the audio reconstructing
information. Two speech augmentation methods are explored in the unsupervised
learning: speed and intensity. The experiments on Google Speech Commands V2
Dataset demonstrated that our CNN-Attention model has competitive results.
Moreover, the augmentation based unsupervised learning could further improve
the classification accuracy of KWS task. In our experiments, with augmentation
based unsupervised learning, our KWS model achieves better performance than
other unsupervised methods, such as CPC, APC, and MPC.

本文研究了一种基于语音增强的无监督学习方法来解决关键词检测任务，提出了一种 CNN-Attention 模型来处理关键词检测任务，并通过两种语音增强方法来提高模型的稳健性和分类效果，实验表明，这种增强式的无监督学习方法能够进一步提高关键词检测的准确率。