Deep learning-based diagnostic systems have demonstrated potential in skin
disease diagnosis. However, their performance can easily degrade on test
domains due to distribution shifts caused by input-level corruptions, such as
imaging equipment variability, brightness changes, and image blur. This will
reduce the reliability of model deployment in real-world scenarios. Most
existing solutions focus on adapting the source model through retraining on
different target domains. Although effective, this retraining process is
sensitive to the amount of data and the hyperparameter configuration for
optimization. In this paper, we propose a test-time image adaptation method to
enhance the accuracy of the model on test data by simultaneously updating and
predicting test images. We modify the target test images by projecting them
back to the source domain using a diffusion model. Specifically, we design a
structure guidance module that adds refinement operations through low-pass
filtering during reverse sampling, regularizing the diffusion to preserve
structural information. Additionally, we introduce a self-ensembling scheme
automatically adjusts the reliance on adapted and unadapted inputs, enhancing
adaptation robustness by rejecting inappropriate generative modeling results.
To facilitate this study, we constructed the ISIC2019-C and Dermnet-C
corruption robustness evaluation benchmarks. Extensive experiments on the
proposed benchmarks demonstrate that our method makes the classifier more
robust across various corruptions, architectures, and data regimes. Our
datasets and code will be available at
https://github.com/minghu0830/Skin-TTA_Diffusion.

我们提出了一种测试时间图像适应方法，通过同时更新和预测测试图像来提高模型在测试数据上的准确性，通过扩散模型将目标测试图像反投影到源域，设计结构指导模块通过低通滤波添加细化操作，用于正则化扩散以保留结构信息，并引入自整合方案自动调整对适应和未适应输入的依赖关系，增强适应鲁棒性。在我们构建的 ISIC2019-C 和 Dermnet-C 损坏鲁棒性评估基准上进行的大量实验表明，我们的方法在各种损坏、体系结构和数据区域上使分类器更加鲁棒。我们的数据集和代码将在 https://github.com/minghu0830/Skin-TTA_Diffusion 上提供。

基于扩散模型的测试时间图像适应性用于鲁棒皮肤病变分类

Diffusion Model Driven Test-Time Image Adaptation for Robust Skin Lesion  Classification

In this study, we investigate what a practically useful approach is in order
to achieve robust skin disease diagnosis. A direct approach is to target the
ground truth diagnosis labels, while an alternative approach instead focuses on
determining skin lesion characteristics that are more visually consistent and
discernible. We argue that, for computer-aided skin disease diagnosis, it is
both more realistic and more useful that lesion type tags should be considered
as the target of an automated diagnosis system such that the system can first
achieve a high accuracy in describing skin lesions, and in turn facilitate
disease diagnosis using lesion characteristics in conjunction with other
evidence. To further meet such an objective, we employ convolutional neural
networks (CNNs) for both the disease-targeted and lesion-targeted
classifications. We have collected a large-scale and diverse dataset of 75,665
skin disease images from six publicly available dermatology atlantes. Then we
train and compare both disease-targeted and lesion-targeted classifiers,
respectively. For disease-targeted classification, only 27.6% top-1 accuracy
and 57.9% top-5 accuracy are achieved with a mean average precision (mAP) of
0.42. In contrast, for lesion-targeted classification, we can achieve a much
higher mAP of 0.70.

本文研究了实现强健的皮肤病诊断的实用方法，并提出一种以皮损为病变类型标签的自动化诊断系统作为目标的方法，并应用卷积神经网络（CNNs）来实现疾病定向诊断和病变定向分类的分类器，并采用来自六个公开皮肤病学大全的 75665 个皮肤病图像来进行训练与测试，结果证明基于病变定向分类的分类器的效果优于疾病定向的分类器。