Text to Speech (TTS) models can generate natural and high-quality speech, but
it is not expressive enough when synthesizing speech with dramatic
expressiveness, such as stand-up comedies. Considering comedians have diverse
personal speech styles, including personal prosody, rhythm, and fillers, it
requires real-world datasets and strong speech style modeling capabilities,
which brings challenges. In this paper, we construct a new dataset and develop
ComedicSpeech, a TTS system tailored for the stand-up comedy synthesis in
low-resource scenarios. First, we extract prosody representation by the prosody
encoder and condition it to the TTS model in a flexible way. Second, we enhance
the personal rhythm modeling by a conditional duration predictor. Third, we
model the personal fillers by introducing comedian-related special tokens.
Experiments show that ComedicSpeech achieves better expressiveness than
baselines with only ten-minute training data for each comedian. The audio
samples are available at this https URL

本研究构建了一个新的数据集，开发了 ComedicSpeech—— 适用于低资源场景下的单口喜剧合成的 TTS 系统，其灵活提取了韵律、个人节奏和填充词等个性特征，并展示了仅使用每位喜剧演员十分钟训练数据的情况下，比基线模型获得更好的表现。