Source separation is the task to separate an audio recording into individual
sound sources. Source separation is fundamental for computational auditory
scene analysis. Previous work on source separation has focused on separating
particular sound classes such as speech and music. Many of previous work
require mixture and clean source pairs for training. In this work, we propose a
source separation framework trained with weakly labelled data. Weakly labelled
data only contains the tags of an audio clip, without the occurrence time of
sound events. We first train a sound event detection system with AudioSet. The
trained sound event detection system is used to detect segments that are mostly
like to contain a target sound event. Then a regression is learnt from a
mixture of two randomly selected segments to a target segment conditioned on
the audio tagging prediction of the target segment. Our proposed system can
separate 527 kinds of sound classes from AudioSet within a single system. A
U-Net is adopted for the separation system and achieves an average SDR of 5.67
dB over 527 sound classes in AudioSet.

本研究提出一种基于弱标注数据训练的源分离框架，利用 AudioSet 训练的音频事件检测系统，实现了对 527 种声音类别的分离，采用了 U-Net 结构，平均信噪比为 5.67dB。

弱标注数据源分离：一种计算听觉场景分析方法

Source separation with weakly labelled data: An approach to  computational auditory scene analysis

Sound event detection (SED) aims to detect when and recognize what sound
events happen in an audio clip. Many supervised SED algorithms rely on strongly
labelled data which contains the onset and offset annotations of sound events.
However, many audio tagging datasets are weakly labelled, that is, only the
presence of the sound events is known, without knowing their onset and offset
annotations. In this paper, we propose a time-frequency (T-F) segmentation
framework trained on weakly labelled data to tackle the sound event detection
and separation problem. In training, a segmentation mapping is applied on a T-F
representation, such as log mel spectrogram of an audio clip to obtain T-F
segmentation masks of sound events. The T-F segmentation masks can be used for
separating the sound events from the background scenes in the time-frequency
domain. Then a classification mapping is applied on the T-F segmentation masks
to estimate the presence probabilities of the sound events. We model the
segmentation mapping using a convolutional neural network and the
classification mapping using a global weighted rank pooling (GWRP). In SED,
predicted onset and offset times can be obtained from the T-F segmentation
masks. As a byproduct, separated waveforms of sound events can be obtained from
the T-F segmentation masks. We remixed the DCASE 2018 Task 1 acoustic scene
data with the DCASE 2018 Task 2 sound events data. When mixing under 0 dB, the
proposed method achieved F1 scores of 0.534, 0.398 and 0.167 in audio tagging,
frame-wise SED and event-wise SED, outperforming the fully connected deep
neural network baseline of 0.331, 0.237 and 0.120, respectively. In T-F
segmentation, we achieved an F1 score of 0.218, where previous methods were not
able to do T-F segmentation.

本文描述了如何使用弱标记的数据，提出了一种基于时频分割框架的声音事件检测和分离方法。文中提出的方法包括使用卷积神经网络处理分割映射和使用全局加权排名池化处理分类映射，从而可以在 F1 方面优于现有方法。

弱标注数据中的声音事件检测和时间频率分割

Sound Event Detection and Time-Frequency Segmentation from Weakly  Labelled Data

This paper investigates the classification of the Audio Set dataset. Audio
Set is a large scale weakly labelled dataset of sound clips. Previous work used
multiple instance learning (MIL) to classify weakly labelled data. In MIL, a
bag consists of several instances, and a bag is labelled positive if at least
one instances in the audio clip is positive. A bag is labelled negative if all
the instances in the bag are negative. We propose an attention model to tackle
the MIL problem and explain this attention model from a novel probabilistic
perspective. We define a probability space on each bag, where each instance in
the bag has a trainable probability measure for each class. Then the
classification of a bag is the expectation of the classification output of the
instances in the bag with respect to the learned probability measure.
Experimental results show that our proposed attention model modeled by fully
connected deep neural network obtains mAP of 0.327 on Audio Set dataset,
outperforming the Google's baseline of 0.314 and recurrent neural network of
0.325.

本文研究 Audio Set 数据集的分类问题，提出了一种基于注意力模型的方法，用于解决多实例学习问题，并且在该数据集上获得了 0.327 的平均精度 (mAP)，优于谷歌基线 (0.314) 和循环神经网络模型 (0.325)。