Target Sound Extraction (TSE) focuses on the problem of separating sources of
interest, indicated by a user's cue, from the input mixture. Most existing
solutions operate in an offline fashion and are not suited to the low-latency
causal processing constraints imposed by applications in live-streamed content
such as augmented hearing. We introduce a family of context-aware low-latency
causal TSE models suitable for real-time processing. First, we explore the
utility of context by providing the TSE model with oracle information about
what sound classes make up the input mixture, where the objective of the model
is to extract one or more sources of interest indicated by the user. Since the
practical applications of oracle models are limited due to their assumptions,
we introduce a composite multi-task training objective involving separation and
classification losses. Our evaluation involving single- and multi-source
extraction shows the benefit of using context information in the model either
by means of providing full context or via the proposed multi-task training loss
without the need for full context information. Specifically, we show that our
proposed model outperforms size- and latency-matched Waveformer, a
state-of-the-art model for real-time TSE.

目标声音提取（TSE）侧重于从输入混音中分离用户提示的感兴趣源的问题。本文介绍了一种适用于实时处理的上下文感知低延迟因果 TSE 模型，并探索了使用上下文信息的效用，既可通过提供完整上下文信息，也可通过提出的多任务训练损失来实现，从而证明我们的模型在实时 TSE 中胜过了 Waveformer 等实时 TSE 的先进模型。