Neural network models using predictive coding are interesting from the
viewpoint of computational modelling of human language acquisition, where the
objective is to understand how linguistic units could be learned from speech
without any labels. Even though several promising predictive coding -based
learning algorithms have been proposed in the literature, it is currently
unclear how well they generalise to different languages and training dataset
sizes. In addition, despite that such models have shown to be effective
phonemic feature learners, it is unclear whether minimisation of the predictive
loss functions of these models also leads to optimal phoneme-like
representations. The present study investigates the behaviour of two predictive
coding models, Autoregressive Predictive Coding and Contrastive Predictive
Coding, in a phoneme discrimination task (ABX task) for two languages with
different dataset sizes. Our experiments show a strong correlation between the
autoregressive loss and the phoneme discrimination scores with the two
datasets. However, to our surprise, the CPC model shows rapid convergence
already after one pass over the training data, and, on average, its
representations outperform those of APC on both languages.

本研究基于两个不同语言的数据集，研究了两种预测编码模型（APC 和 CPC）的行为，发现 CPC 模型在短时间内已经取得了更好的表现，其预测损失优化后的表现也符合语音识别领域中音素特征学习的最优化要求。