Although Singing Voice Synthesis (SVS) has made great strides with
Text-to-Speech (TTS) techniques, multilingual singing voice modeling remains
relatively unexplored. This paper presents BiSinger, a bilingual SVS system for
English and Chinese Mandarin. Current systems require separate models per
language and cannot accurately represent both Chinese and English, hindering
code-switch SVS. To address this gap, we design a shared representation between
Chinese and English singing voices, achieved by using the CMU dictionary with
mapping rules. We fuse monolingual singing datasets with established singing
voice conversion techniques to generate bilingual singing voices while also
exploring the potential use of bilingual speech data. Experiments affirm that
our language-independent representation and incorporation of related datasets
enable a single model with enhanced performance in English and code-switch SVS
while maintaining Chinese song performance. Audio samples are available at
this https URL

设计了一个双语 SVS 系统用于英语和汉语普通话的人声合成，并通过使用 CMU 词典与映射规则实现中文和英语歌声之间的共享表示，融合了单语歌唱数据集和已建立的歌声转换技术来生成双语歌声，并探索了双语语音数据的潜在用途。通过实验证实，我们的语言独立表示和相关数据集的融合使得单一模型在英语和 code-switch SVS 中获得了强化的性能，同时保持了中文歌曲的表现。