Audio pattern recognition is an important research topic in the machine
learning area, and includes several tasks such as audio tagging, acoustic scene
classification, music classification, speech emotion classification and sound
event detection. Recently, neural networks have been applied to tackle audio
pattern recognition problems. However, previous systems are built on specific
datasets with limited durations. Recently, in computer vision and natural
language processing, systems pretrained on large-scale datasets have
generalized well to several tasks. However, there is limited research on
pretraining systems on large-scale datasets for audio pattern recognition. In
this paper, we propose pretrained audio neural networks (PANNs) trained on the
large-scale AudioSet dataset. These PANNs are transferred to other audio
related tasks. We investigate the performance and computational complexity of
PANNs modeled by a variety of convolutional neural networks. We propose an
architecture called Wavegram-Logmel-CNN using both log-mel spectrogram and
waveform as input feature. Our best PANN system achieves a state-of-the-art
mean average precision (mAP) of 0.439 on AudioSet tagging, outperforming the
best previous system of 0.392. We transfer PANNs to six audio pattern
recognition tasks, and demonstrate state-of-the-art performance in several of
those tasks. We have released the source code and pretrained models of PANNs:
this https URL

本论文提出了使用大型数据集 AudioSet 预训练的音频神经网络（PANNs），并将 PANNs 迁移到其他音频相关任务中，其中最好的 PANN 系统在 AudioSet 标记上实现了 0.439 的最高平均精度（mAP）。