This work investigates the use of deep fully convolutional neural networks (DFCNN) for pixel-wise scene labeling of Earth Observation images. Especially, we train a variant of the SegNet architecture on remote sensing data over an urban area and study different strategies for performing accurate semantic segmentation. Our contributions are the following: 1) we transfer efficiently a DFCNN from generic everyday images to remote sensing images; 2) we introduce a multi-kernel convolutional layer for fast aggregation of predictions at multiple scales; 3) we perform data fusion from heterogeneous sensors (optical and laser) using residual correction. Our framework improves state-of-the-art accuracy on the ISPRS Vaihingen 2D Semantic Labeling dataset.

本文研究了使用深度完全卷积神经网络（DFCNN）对地观测图像进行像素级场景标记。作者使用了变种的SegNet架构对城市区域的遥感数据进行训练，并研究了不同的准确语义分割方法。作者提出以下贡献：1）作者有效地将DFCNN从常规日常图像转移到遥感图像领域；2）作者引入了一个多核卷积层以便于对多个尺度上的预测进行快速聚合；3）作者使用残差校正对异构传感器（光学和激光）的数据进行融合。所提出的方法在ISPRS Vaihingen 2D语义标记数据集上改进了现有技术的准确率。

多模态和多尺度深度网络在地球观测数据的语义分割中的应用