Vision-Language Pre-training (VLP) that utilizes the multi-modal information
to promote the training efficiency and effectiveness, has achieved great
success in vision recognition of natural domains and shown promise in medical
imaging diagnosis for the Chest X-Rays (CXRs). However, current works mainly
pay attention to the exploration on single dataset of CXRs, which locks the
potential of this powerful paradigm on larger hybrid of multi-source CXRs
datasets. We identify that although blending samples from the diverse sources
offers the advantages to improve the model generalization, it is still
challenging to maintain the consistent superiority for the task of each source
due to the existing heterogeneity among sources. To handle this dilemma, we
design a Conquer-and-Divide pre-training framework, termed as UniChest, aiming
to make full use of the collaboration benefit of multiple sources of CXRs while
reducing the negative influence of the source heterogeneity. Specially, the
``Conquer" stage in UniChest encourages the model to sufficiently capture
multi-source common patterns, and the ``Divide" stage helps squeeze
personalized patterns into different small experts (query networks). We conduct
thorough experiments on many benchmarks, e.g., ChestX-ray14, CheXpert,
Vindr-CXR, Shenzhen, Open-I and SIIM-ACR Pneumothorax, verifying the
effectiveness of UniChest over a range of baselines, and release our codes and
pre-training models at this https URL

利用多模态信息的视觉语言预训练（VLP）在自然领域的视觉识别和胸部 X 射线（CXR）的医学影像诊断方面取得了重大成功，在单个 CXR 数据集的探索方面取得了良好的前景，但目前的工作主要关注单个 CXRs 数据集的探索，这限制了该强大范式在更大规模的多源 CXRs 数据集上的潜力。为了解决这个困境，我们设计了一个征服与分割的预训练框架，称为 UniChest，旨在充分利用多个源 CXRs 的协作优势，同时减少源异质性的负面影响。