In image fusion tasks, images from different sources possess distinct
characteristics. This has driven the development of numerous methods to explore
better ways of fusing them while preserving their respective characteristics.
Mamba, as a state space model, has emerged in the field of natural language
processing. Recently, many studies have attempted to extend Mamba to vision
tasks. However, due to the nature of images different from casual language
sequences, the limited state capacity of Mamba weakens its ability to model
image information. Additionally, the sequence modeling ability of Mamba is only
capable of spatial information and cannot effectively capture the rich spectral
information in images. Motivated by these challenges, we customize and improve
the vision Mamba network designed for the image fusion task. Specifically, we
propose the local-enhanced vision Mamba block, dubbed as LEVM. The LEVM block
can improve local information perception of the network and simultaneously
learn local and global spatial information. Furthermore, we propose the state
sharing technique to enhance spatial details and integrate spatial and spectral
information. Finally, the overall network is a multi-scale structure based on
vision Mamba, called LE-Mamba. Extensive experiments show the proposed methods
achieve state-of-the-art results on multispectral pansharpening and
multispectral and hyperspectral image fusion datasets, and demonstrate the
effectiveness of the proposed approach. Code will be made available.

基于 Mamba 算法的本地增强视觉 Mamba（LEVM）块和状态共享技术的图像融合网络（LE-Mamba）在多光谱和高光谱图像融合数据集上取得了最先进的结果，证明了该方法的有效性。