Mel-filterbanks are fixed, engineered audio features which emulate human
perception and have been used through the history of audio understanding up to
today. However, their undeniable qualities are counterbalanced by the
fundamental limitations of handmade representations. In this work we show that
we can train a single learnable frontend that outperforms mel-filterbanks on a
wide range of audio signals, including speech, music, audio events and animal
sounds, providing a general-purpose learned frontend for audio classification.
To do so, we introduce a new principled, lightweight, fully learnable
architecture that can be used as a drop-in replacement of mel-filterbanks. Our
system learns all operations of audio features extraction, from filtering to
pooling, compression and normalization, and can be integrated into any neural
network at a negligible parameter cost. We perform multi-task training on eight
diverse audio classification tasks, and show consistent improvements of our
model over mel-filterbanks and previous learnable alternatives. Moreover, our
system outperforms the current state-of-the-art learnable frontend on Audioset,
with orders of magnitude fewer parameters.

利用可学习前端代替 mel-filterbank，可普适于语音、音乐、声音事件和动物声音信号的分类，同时在多种分类任务和 Audioset 中表现出比 mel-filterbank 更好的性能，且参数更少。