The semantic segmentation of skin lesions is an important and common initial task in the computer aided diagnosis of dermoscopic images. Although deep learning-based approaches have considerably improved the segmentation accuracy, there is still room for improvement by addressing the major challenges, such as variations in lesion shape, size, color and varying levels of contrast. In this work, we propose the first deep semantic segmentation framework for dermoscopic images which incorporates, along with the original RGB images, information extracted using the physics of skin illumination and imaging. In particular, we incorporate information from specific color bands, illumination invariant grayscale images, and shading-attenuated images. We evaluate our method on three datasets: the ISBI ISIC 2017 Skin Lesion Segmentation Challenge dataset, the DermoFit Image Library, and the PH2 dataset and observe improvements of 12.02%, 4.30%, and 8.86% respectively in the mean Jaccard index over a baseline model trained only with RGB images.

本文提出了基于深度学习和皮肤照明成像物理的深度语义分割框架，该方法结合了RGB图像和从不同光谱颜色的照明不变的灰度图像、阴影衰减图像等不同信息，应用于三个数据集并取得了12.02%、4.30%和8.86%的平均Jaccard Index提升。

基于照明的变换改进皮肤镜图像中的皮损分割