In this study, we propose a novel noise adaptive speech enhancement (SE)
system, which employs a domain adversarial training (DAT) approach to tackle
the issue of a noise type mismatch between the training and testing conditions.
Such a mismatch is a critical problem in deep-learning-based SE systems. A
large mismatch may cause a serious performance degradation to the SE
performance. Because we generally use a well-trained SE system to handle
various unseen noise types, a noise type mismatch commonly occurs in real-world
scenarios. The proposed noise adaptive SE system contains an
encoder-decoder-based enhancement model and a domain discriminator model.
During adaptation, the DAT approach encourages the encoder to produce
noise-invariant features based on the information from the discriminator model
and consequentially increases the robustness of the enhancement model to unseen
noise types. Herein, we regard stationary noises as the source domain (with the
ground truth of clean speech) and non-stationary noises as the target domain
(without the ground truth). We evaluated the proposed system on TIMIT
sentences. The experiment results show that the proposed noise adaptive SE
system successfully provides significant improvements in PESQ (19.0%), SSNR
(39.3%), and STOI (27.0%) over the SE system without an adaptation.

该研究提出了一种新颖的噪声自适应语音增强系统，该系统采用领域对抗训练方法解决训练和测试条件之间的噪声类型不匹配问题。实验结果表明，相较于没有自适应的 SE 系统，该系统在 PESQ、SSNR 和 STOI 方面可实现显著改善。