Language identification is the task of automatically determining the identity
of a language conveyed by a spoken segment. It has a profound impact on the
multilingual interoperability of an intelligent speech system. Despite language
identification attaining high accuracy on medium or long utterances(>3s), the
performance on short utterances (<=1s) is still far from satisfactory. We
propose a BERT-based language identification system (BERT-LID) to improve
language identification performance, especially on short-duration speech
segments. We extend the original BERT model by taking the phonetic
posteriorgrams (PPG) derived from the front-end phone recognizer as input. Then
we deployed the optimal deep classifier followed by it for language
identification. Our BERT-LID model can improve the baseline accuracy by about
6.5% on long-segment identification and 19.9% on short-segment identification,
demonstrating our BERT-LID's effectiveness to language identification.

我们提出了一种基于 BERT 的语言识别系统，通过提取从前端语音识别器导出的语音学后向图（PPG）作为输入，可以提高较短语音段的语言识别表现，该模型可以提高长语音段识别的基准准确率约 6.5％，提高短语音段识别的基准准确率约 19.9％，表明 BERT-LID 在语言识别方面是有效的。