Recurrent neural networks and Transformers have recently dominated most
applications in hyperspectral (HS) imaging, owing to their capability to
capture long-range dependencies from spectrum sequences. However, despite the
success of these sequential architectures, the non-ignorable inefficiency
caused by either difficulty in parallelization or computationally prohibitive
attention still hinders their practicality, especially for large-scale
observation in remote sensing scenarios. To address this issue, we herein
propose SpectralMamba -- a novel state space model incorporated efficient deep
learning framework for HS image classification. SpectralMamba features the
simplified but adequate modeling of HS data dynamics at two levels. First, in
spatial-spectral space, a dynamical mask is learned by efficient convolutions
to simultaneously encode spatial regularity and spectral peculiarity, thus
attenuating the spectral variability and confusion in discriminative
representation learning. Second, the merged spectrum can then be efficiently
operated in the hidden state space with all parameters learned input-dependent,
yielding selectively focused responses without reliance on redundant attention
or imparallelizable recurrence. To explore the room for further computational
downsizing, a piece-wise scanning mechanism is employed in-between,
transferring approximately continuous spectrum into sequences with squeezed
length while maintaining short- and long-term contextual profiles among
hundreds of bands. Through extensive experiments on four benchmark HS datasets
acquired by satellite-, aircraft-, and UAV-borne imagers, SpectralMamba
surprisingly creates promising win-wins from both performance and efficiency
perspectives.

SpectralMamba 是一种高效的深度学习框架，结合了状态空间模型来进行高光谱图像分类，通过学习动态掩膜和合并光谱的操作在隐藏状态空间中实现了选择性的响应，同时在计算效率和性能角度上取得了令人满意的成果。