The Segmentation Anything Model (SAM) has recently emerged as a foundation model for addressing image segmentation. Owing to the intrinsic complexity of medical images and the high annotation cost, the medical image segmentation (MIS) community has been encouraged to investigate SAM's zero-shot capabilities to facilitate automatic annotation. Inspired by the extraordinary accomplishments of interactive medical image segmentation (IMIS) paradigm, this paper focuses on assessing the potential of SAM's zero-shot capabilities within the IMIS paradigm to amplify its benefits in the MIS domain. Regrettably, we observe that SAM's vulnerability to prompt forms (e.g., points, bounding boxes) becomes notably pronounced in IMIS. This leads us to develop a framework that adaptively offers suitable prompt forms for human experts. We refer to the framework above as temporally-extended prompts optimization (TEPO) and model it as a Markov decision process, solvable through reinforcement learning. Numerical experiments on the standardized benchmark BraTS2020 demonstrate that the learned TEPO agent can further enhance SAM's zero-shot capability in the MIS context.

本文研究了使用交互式医学图像分割范例中的 SAM 零-shot 能力增强医学图像分割的潜力，并提出了一种叫做 TEPO 的自适应提示形式优化框架来解决人类专家支持下的SAM 脆弱性问题，并通过强化学习来进一步提高 SAM 在 MIS 上的零-shot 能力。在标准基准 BraTS2020 上的数值实验表明，学习到的 TEPO 代理可以进一步增强 SAM 在 MIS 上的零-shot 能力。

SAM交互式医学图像分割的拓展时间提示优化