Utterance-level permutation invariant training (uPIT) has achieved promising
progress on single-channel multi-talker speech separation task. Long short-term
memory (LSTM) and bidirectional LSTM (BLSTM) are widely used as the separation
networks of uPIT, i.e. uPIT-LSTM and uPIT-BLSTM. uPIT-LSTM has lower latency
but worse performance, while uPIT-BLSTM has better performance but higher
latency. In this paper, we propose using latency-controlled BLSTM (LC-BLSTM)
during inference to fulfill low-latency and good-performance speech separation.
To find a better training strategy for BLSTM-based separation network,
chunk-level PIT (cPIT) and uPIT are compared. The experimental results show
that uPIT outperforms cPIT when LC-BLSTM is used during inference. It is also
found that the inter-chunk speaker tracing (ST) can further improve the
separation performance of uPIT-LC-BLSTM. Evaluated on the WSJ0 two-talker
mixed-speech separation task, the absolute gap of signal-to-distortion ratio
(SDR) between uPIT-BLSTM and uPIT-LC-BLSTM is reduced to within 0.7 dB.

本文提出使用延迟控制的 BLSTM (LC-BLSTM) 以在推理期间完成低延迟和良好性能的语音分离，并发现在使用 LC-BLSTM 期间，uPIT 优于 cPIT，进一步通过跨块说话者跟踪（ST）可以提高 uPIT-LC-BLSTM 的分离性能，并且在 WSJ0 两个人混音语音分离任务中评估，uPIT-BLSTM 和 uPIT-LC-BLSTM 之间的信号失真比（SDR）的绝对差距缩小到 0.7dB 以内。