YourTTS brings the power of a multilingual approach to the task of zero-shot
multi-speaker TTS. Our method builds upon the VITS model and adds several novel
modifications for zero-shot multi-speaker and multilingual training. We
achieved state-of-the-art (SOTA) results in zero-shot multi-speaker TTS and
results comparable to SOTA in zero-shot voice conversion on the VCTK dataset.
Additionally, our approach achieves promising results in a target language with
a single-speaker dataset, opening possibilities for zero-shot multi-speaker TTS
and zero-shot voice conversion systems in low-resource languages. Finally, it
is possible to fine-tune the YourTTS model with less than 1 minute of speech
and achieve state-of-the-art results in voice similarity and with reasonable
quality. This is important to allow synthesis for speakers with a very
different voice or recording characteristics from those seen during training.

该研究使用多语言方法进行零样本多说者语音合成，可在低资源语种上实现零样本语音转换，使用 VITS 模型，经过多项创新修改后，在 VCTK 数据集上实现了最先进的结果，并且可以在少于 1 分钟的输入语音上对 YourTTS 进行微调以获得最佳效果。