BriefGPT.xyz
Mar, 2024
解剖结构导向的医学视觉语言预训练
Anatomical Structure-Guided Medical Vision-Language Pre-training
HTML
PDF
Qingqiu Li, Xiaohan Yan, Jilan Xu, Runtian Yuan, Yuejie Zhang...
TL;DR
通过视觉语言预训练学习医学视觉表示已取得显著进展,本研究提出了一种以解剖结构为指导的框架(ASG),以解决局部对齐的可解释性和临床相关性不足,以及图像-报告对的内外表示学习不足的问题。通过自动解剖句子对齐,并将发现和存在视为图像标签,该方法在五个公共基准数据集上展示出优于现有方法的实验结果。
Abstract
Learning
medical visual representations
through
vision-language pre-training
has reached remarkable progress. Despite the promising performance, it still faces challenges, i.e., local alignment lacks interpretabi
→