In this paper, we propose a method of speaker adaption with intuitive
prosodic features for statistical parametric speech synthesis. The intuitive
prosodic features employed in this method include pitch, pitch range, speech
rate and energy considering that they are directly related with the overall
prosodic characteristics of different speakers. The intuitive prosodic features
are extracted at utterance-level or speaker-level, and are further integrated
into the existing speaker-encoding-based and speaker-embedding-based adaptation
frameworks respectively. The acoustic models are sequence-to-sequence ones
based on Tacotron2. Intuitive prosodic features are concatenated with text
encoder outputs and speaker vectors for decoding acoustic features.Experimental
results have demonstrated that our proposed methods can achieve better
objective and subjective performance than the baseline methods without
intuitive prosodic features. Besides, the proposed speaker adaption method with
utterance-level prosodic features has achieved the best similarity of synthetic
speech among all compared methods.

本论文提出了一种利用直观韵律特征进行说话人适应的方法，在 Tacotron2 的基础上，将直观韵律特征与文本编码器的输出和说话人向量拼接编码，实现音频的转换，在客观和主观的表现上都超过了基准方法，其中基于话语层面的直观韵律特征的方法达到了所有比较方法中最好的合成音相似度。