Ultrasound tongue imaging (UTI) provides a convenient way to visualize the
vocal tract during speech production. UTI is increasingly being used for speech
therapy, making it important to develop automatic methods to assist various
time-consuming manual tasks currently performed by speech therapists. A key
challenge is to generalize the automatic processing of ultrasound tongue images
to previously unseen speakers. In this work, we investigate the classification
of phonetic segments (tongue shapes) from raw ultrasound recordings under
several training scenarios: speaker-dependent, multi-speaker,
speaker-independent, and speaker-adapted. We observe that models underperform
when applied to data from speakers not seen at training time. However, when
provided with minimal additional speaker information, such as the mean
ultrasound frame, the models generalize better to unseen speakers.

本文研究使用超声舌头成像技术对语音产生的过程进行可视化，并通过多种训练方案探讨了从原始超声记录中对语音的分类方法，研究表明，提供最少的额外讲话者信息可以有助于模型更好地推广到未知的讲话者中。