Non-parallel many-to-many voice conversion remains an interesting but
challenging speech processing task. Recently, AutoVC, a conditional autoencoder
based method, achieved excellent conversion results by disentangling the
speaker identity and the speech content using information-constraining
bottlenecks. However, due to the pure autoencoder training method, it is
difficult to evaluate the separation effect of content and speaker identity. In
this paper, a novel voice conversion framework, named $\boldsymbol T$ext
$\boldsymbol G$uided $\boldsymbol A$utoVC(TGAVC), is proposed to more
effectively separate content and timbre from speech, where an expected content
embedding produced based on the text transcriptions is designed to guide the
extraction of voice content. In addition, the adversarial training is applied
to eliminate the speaker identity information in the estimated content
embedding extracted from speech. Under the guidance of the expected content
embedding and the adversarial training, the content encoder is trained to
extract speaker-independent content embedding from speech. Experiments on
AIShell-3 dataset show that the proposed model outperforms AutoVC in terms of
naturalness and similarity of converted speech.

本文提出了一种名为 TGAVC 的语音转换框架，通过望文生义的内容嵌入，辅助提取正文内容并应用对抗训练消除说话人身份信息，从而更有效地分离语音的内容和音色。实验结果表明，TGAVC 模型在自然度和转换语音的相似度上优于 AutoVC。