The performance of acoustic models degrades notably in noisy environments.
Speech enhancement (SE) can be used as a front-end strategy to aid automatic
speech recognition (ASR) systems. However, existing training objectives of SE
methods are not fully effective at integrating speech-text and noisy-clean
paired data for training toward unseen ASR systems. In this study, we propose a
general denoising framework, D4AM, for various downstream acoustic models. Our
framework fine-tunes the SE model with the backward gradient according to a
specific acoustic model and the corresponding classification objective. In
addition, our method aims to consider the regression objective as an auxiliary
loss to make the SE model generalize to other unseen acoustic models. To
jointly train an SE unit with regression and classification objectives, D4AM
uses an adjustment scheme to directly estimate suitable weighting coefficients
rather than undergoing a grid search process with additional training costs.
The adjustment scheme consists of two parts: gradient calibration and
regression objective weighting. The experimental results show that D4AM can
consistently and effectively provide improvements to various unseen acoustic
models and outperforms other combination setups. Specifically, when evaluated
on the Google ASR API with real noisy data completely unseen during SE
training, D4AM achieves a relative WER reduction of 24.65% compared with the
direct feeding of noisy input. To our knowledge, this is the first work that
deploys an effective combination scheme of regression (denoising) and
classification (ASR) objectives to derive a general pre-processor applicable to
various unseen ASR systems. Our code is available at
this https URL

在嘈杂环境中，声学模型的性能明显下降。本研究提出了一种用于各种下游声学模型的通用降噪框架 D4AM，通过特定声学模型和相应的分类目标，用反向梯度调整语音增强模型并考虑回归目标作为辅助损失，该方法可以直接估计合适的权重系数，从而避免了额外的训练成本，并有效改善各种未知声学模型的性能。该框架在 Google ASR API 上进行实验，相对于直接使用嘈杂输入，取得了 24.65% 的相对 WER 降低，是首个实现回归和分类目标有效组合的通用预处理器适用于各种未知 ASR 系统的工作。

D4AM：用于下游声学模型的通用去噪框架

D4AM: A General Denoising Framework for Downstream Acoustic Models

The performance of speaker verification (SV) models may drop dramatically in
noisy environments. A speech enhancement (SE) module can be used as a front-end
strategy. However, existing SE methods may fail to bring performance
improvements to downstream SV systems due to artifacts in the predicted signals
of SE models. To compensate for artifacts, we propose a generic denoising
framework named LC4SV, which can serve as a pre-processor for various unknown
downstream SV models. In LC4SV, we employ a learning-based interpolation agent
to automatically generate the appropriate coefficients between the enhanced
signal and its noisy input to improve SV performance in noisy environments. Our
experimental results demonstrate that LC4SV consistently improves the
performance of various unseen SV systems. To the best of our knowledge, this
work is the first attempt to develop a learning-based interpolation scheme
aiming at improving SV performance in noisy environments.

在嘈杂环境中，为了提高演讲者验证（SV）模型的性能，我们提出了一个名为 LC4SV 的通用降噪框架，采用学习为基础的插值代理，自动生成增强信号与噪声输入之间合适的系数，从而改善 SV 系统的性能。