Recently, direct modeling of raw waveforms using deep neural networks has
been widely studied for a number of tasks in audio domains. In speaker
verification, however, utilization of raw waveforms is in its preliminary
phase, requiring further investigation. In this study, we explore end-to-end
deep neural networks that input raw waveforms to improve various aspects:
front-end speaker embedding extraction including model architecture,
pre-training scheme, additional objective functions, and back-end
classification. Adjustment of model architecture using a pre-training scheme
can extract speaker embeddings, giving a significant improvement in
performance. Additional objective functions simplify the process of extracting
speaker embeddings by merging conventional two-phase processes: extracting
utterance-level features such as i-vectors or x-vectors and the feature
enhancement phase, e.g., linear discriminant analysis. Effective back-end
classification models that suit the proposed speaker embedding are also
explored. We propose an end-to-end system that comprises two deep neural
networks, one front-end for utterance-level speaker embedding extraction and
the other for back-end classification. Experiments conducted on the VoxCeleb1
dataset demonstrate that the proposed model achieves state-of-the-art
performance among systems without data augmentation. The proposed system is
also comparable to the state-of-the-art x-vector system that adopts data
augmentation.

本文提出了一种端到端的系统，该系统包含两个深度神经网络，其一个用于提取语音级别的说话者嵌入，另一个用于后端分类，通过具有预训练方案的模型架构调整可以提取说话者嵌入，并使用附加目标函数简化提取过程，此系统在 VoxCeleb1 数据集上实现了同等于具有数据增强的最先进的 x 向量系统的表现。