In this paper, we propose a textless acoustic model with a self-supervised
distillation strategy for noise-robust expressive speech-to-speech translation
(S2ST). Recently proposed expressive S2ST systems have achieved impressive
expressivity preservation performances by cascading unit-to-speech (U2S)
generator to the speech-to-unit translation model. However, these systems are
vulnerable to the presence of noise in input speech, which is an assumption in
real-world translation scenarios. To address this limitation, we propose a U2S
generator that incorporates a distillation with no label (DINO) self-supervised
training strategy into it's pretraining process. Because the proposed method
captures noise-agnostic expressivity representation, it can generate qualified
speech even in noisy environment. Objective and subjective evaluation results
verified that the proposed method significantly improved the performance of the
expressive S2ST system in noisy environments while maintaining competitive
performance in clean environments.

提出了一种文本无关的声学模型与自我监督蒸馏策略相结合的噪声鲁棒表达式语音翻译 (S2ST) 模型，通过将 U2S 生成器与语音到单元翻译模型级联，可以在存在噪声的环境中生成高质量的语音，并在干净环境中保持竞争性性能。