Medical visual question answering (Med-VQA) aims to automate the prediction
of correct answers for medical images and questions, thereby assisting
physicians in reducing repetitive tasks and alleviating their workload.
Existing approaches primarily focus on pre-training models using additional and
comprehensive datasets, followed by fine-tuning to enhance performance in
downstream tasks. However, there is also significant value in exploring
existing models to extract clinically relevant information. In this paper, we
propose the Latent Prompt Assist model (LaPA) for medical visual question
answering. Firstly, we design a latent prompt generation module to generate the
latent prompt with the constraint of the target answer. Subsequently, we
propose a multi-modal fusion block with latent prompt fusion module that
utilizes the latent prompt to extract clinical-relevant information from
uni-modal and multi-modal features. Additionally, we introduce a prior
knowledge fusion module to integrate the relationship between diseases and
organs with the clinical-relevant information. Finally, we combine the final
integrated information with image-language cross-modal information to predict
the final answers. Experimental results on three publicly available Med-VQA
datasets demonstrate that LaPA outperforms the state-of-the-art model ARL,
achieving improvements of 1.83%, 0.63%, and 1.80% on VQA-RAD, SLAKE, and
VQA-2019, respectively. The code is publicly available at
this https URL

给出一个概述只需一句简短的中文描述是：本研究提出了 LaPA 模型，用于医学视觉问答。通过设计潜在提示生成模块、多模态融合块、和先验知识融合模块，利用潜在提示从单模态和多模态特征提取临床相关信息，并结合图像 - 语言跨模态信息预测最终答案。实验结果表明 LaPA 模型在三个公开的医学视觉问答数据集上胜过了现有的最先进模型 ARL，分别在 VQA-RAD、SLAKE 和 VQA-2019 上达到了 1.83%、0.63% 和 1.80% 的改进。