Current machine learning methods for medical image analysis primarily focus on developing models tailored for their specific tasks, utilizing data within their target domain. These specialized models tend to be data-hungry and often exhibit limitations in generalizing to out-of-distribution samples. Recently, foundation models have been proposed, which combine data from various domains and demonstrate excellent generalization capabilities. Building upon this, this work introduces the incorporation of diverse medical image domains, including different imaging modalities like X-ray, MRI, CT, and ultrasound images, as well as various viewpoints such as axial, coronal, and sagittal views. We refer to this approach as multi-domain model and compare its performance to that of specialized models. Our findings underscore the superior generalization capabilities of multi-domain models, particularly in scenarios characterized by limited data availability and out-of-distribution, frequently encountered in healthcare applications. The integration of diverse data allows multi-domain models to utilize shared information across domains, enhancing the overall outcomes significantly. To illustrate, for organ recognition, multi-domain model can enhance accuracy by up to 10% compared to conventional specialized models.

当前医学图像分析的机器学习方法主要集中在为特定任务开发定制模型，利用其目标域内的数据。最近，提出了基础模型，它结合了来自各种领域的数据，并展现出出色的泛化能力。本研究在此基础上引入了多领域医学图像的结合，包括不同的成像方式如X线、MRI、CT和超声图像，以及各种视角如轴位、冠状位和矢状位。我们称之为多领域模型，并将其性能与特定模型进行了对比。研究结果强调了多领域模型在数据有限和常遇到的超出分布情况下的优越泛化能力，尤其在医疗应用中。多样数据的整合使多领域模型能够利用跨领域的共享信息，显著提高整体结果。举例而言，在器官识别方面，与传统专用模型相比，多领域模型的准确性可以提高10%。

多域改善医学图像分析的超出分布和数据有限情境