Recent advances in vision-language pre-training have demonstrated astounding performances in diverse vision-language tasks, shedding a light on the long-standing problems of a comprehensive understanding of both visual and textual concepts in artificial intelligence research. However, there has been limited success in the application of vision-language pre-training in the medical domain, as the current vision-language models and learning strategies for photographic images and captions are not optimal to process the medical data which are usually insufficient in the amount and the diversity, which impedes successful learning of joint vision-language concepts. In this study, we introduce MAX-VL, a model tailored for efficient vision-language pre-training in the medical domain. We experimentally demonstrated that the pre-trained MAX-VL model outperforms the current state-of-the-art vision language models in various vision-language tasks. We also suggested the clinical utility for the diagnosis of newly emerging diseases and human error detection as well as showed the widespread applicability of the model in different domain data.

该研究介绍了一种适用于医学领域的自我监督视觉语言预训练模型Medical X-VL，展示该模型在医学领域的视觉语言任务中的超越性能，并证明了在新疾病诊断和监测人类错误等方面，Oversight AI具有广泛的应用潜力。

自我监督的共同学习：对未加工的医疗影像和报告进行处理，实现放射学AI监督