Spectral super-resolution (SSR) aims at generating a hyperspectral image
(HSI) from a given RGB image. Recently, a promising direction for SSR is to
learn a complicated mapping function from the RGB image to the HSI counterpart
using a deep convolutional neural network. This essentially involves mapping
the RGB context within a size-specific receptive field centered at each pixel
to its spectrum in the HSI. The focus thereon is to appropriately determine the
receptive field size and establish the mapping function from RGB context to the
corresponding spectrum. Due to their differences in category or spatial
position, pixels in HSIs often require different-sized receptive fields and
distinct mapping functions. However, few efforts have been invested to
explicitly exploit this prior.
To address this problem, we propose a pixel-aware deep function-mixture
network for SSR, which is composed of a new class of modules, termed
function-mixture (FM) blocks. Each FM block is equipped with some basis
functions, i.e., parallel subnets of different-sized receptive fields. Besides,
it incorporates an extra subnet as a mixing function to generate pixel-wise
weights, and then linearly mixes the outputs of all basis functions with those
generated weights. This enables us to pixel-wisely determine the receptive
field size and the mapping function. Moreover, we stack several such FM blocks
to further increase the flexibility of the network in learning the pixel-wise
mapping. To encourage feature reuse, intermediate features generated by the FM
blocks are fused in late stage, which proves to be effective for boosting the
SSR performance. Experimental results on three benchmark HSI datasets
demonstrate the superiority of the proposed method.

提出了一种基于像素的深度函数混合网络，其中包括一种新的模块，称为函数混合（FM）块，用于光谱超分辨率，以确定每个像素的接受域大小和映射函数，并使用 late-stage 的中间特征增强了性能，在三个基准 HSI 数据集上验证其优越性。