Multiple instance learning (MIL) has emerged as a popular method for classifying histopathology whole slide images (WSIs). Existing approaches typically rely on frozen pre-trained models to extract instance features, neglecting the substantial domain shift between pre-training natural and histopathological images. To address this issue, we propose PAMT, a novel Prompt-guided Adaptive Model Transformation framework that enhances MIL classification performance by seamlessly adapting pre-trained models to the specific characteristics of histopathology data. To capture the intricate histopathology distribution, we introduce Representative Patch Sampling (RPS) and Prototypical Visual Prompt (PVP) to reform the input data, building a compact while informative representation. Furthermore, to narrow the domain gap, we introduce Adaptive Model Transformation (AMT) that integrates adapter blocks within the feature extraction pipeline, enabling the pre-trained models to learn domain-specific features. We rigorously evaluate our approach on two publicly available datasets, Camelyon16 and TCGA-NSCLC, showcasing substantial improvements across various MIL models. Our findings affirm the potential of PAMT to set a new benchmark in WSI classification, underscoring the value of a targeted reprogramming approach.

多实例学习（MIL）作为一种流行的方法正在用于对组织病理学全幅切片图像进行分类。作者提出了PAMT，这是一种新颖的基于提示的自适应模型转换框架，通过无缝地将预训练模型适应组织病理学数据的特点来提高MIL分类性能。作者引入了代表性补丁采样（RPS）和典型视觉提示（PVP）来重构输入数据，构建一个紧凑而且信息丰富的表示。此外，为了缩小域差异，作者在特征提取流水线中引入了适应性模型转换（AMT），使预训练模型能够学习特定领域的特征。作者在两个公开数据集Camelyon16和TCGA-NSCLC上对该方法进行了严格评估，展示了各种MIL模型的显著改进。作者的发现证实了PAMT在WSI分类中的潜力，强调了有针对性的重新编程方法的价值。

基于提示的自适应模型转换用于大规模图像分类