We propose Jointly trained Duration Informed Transformer (JDI-T), a
feed-forward Transformer with a duration predictor jointly trained without
explicit alignments in order to generate an acoustic feature sequence from an
input text. In this work, inspired by the recent success of the duration
informed networks such as FastSpeech and DurIAN, we further simplify its
sequential, two-stage training pipeline to a single-stage training.
Specifically, we extract the phoneme duration from the autoregressive
Transformer on the fly during the joint training instead of pretraining the
autoregressive model and using it as a phoneme duration extractor. To our best
knowledge, it is the first implementation to jointly train the feed-forward
Transformer without relying on a pre-trained phoneme duration extractor in a
single training pipeline. We evaluate the effectiveness of the proposed model
on the publicly available Korean Single speaker Speech (KSS) dataset compared
to the baseline text-to-speech (TTS) models trained by ESPnet-TTS.

本文提出了 JDI-T 模型，它是一个带有持续时间预测器的前馈 Transformer，经过联合训练可以从输入文本生成声学特征序列。该模型是第一个在单一训练过程中联合训练前馈 Transformer，而无需依赖预先训练的音素持续时间提取器。在公开数据集 KSS 上与基线 ESPnet-TTS 模型进行比较，实验证明该模型有效性较高。