Medical Report Grounding is pivotal in identifying the most relevant regions
in medical images based on a given phrase query, a critical aspect in medical
image analysis and radiological diagnosis. However, prevailing visual grounding
approaches necessitate the manual extraction of key phrases from medical
reports, imposing substantial burdens on both system efficiency and physicians.
In this paper, we introduce a novel framework, Medical Report Grounding
(MedRG), an end-to-end solution for utilizing a multi-modal Large Language
Model to predict key phrase by incorporating a unique token, BOX, into the
vocabulary to serve as an embedding for unlocking detection capabilities.
Subsequently, the vision encoder-decoder jointly decodes the hidden embedding
and the input medical image, generating the corresponding grounding box. The
experimental results validate the effectiveness of MedRG, surpassing the
performance of the existing state-of-the-art medical phrase grounding methods.
This study represents a pioneering exploration of the medical report grounding
task, marking the first-ever endeavor in this domain.

通过引入一个新的框架 MedRG，该研究利用多模态大型语言模型预测关键短语，并结合视觉编码器 - 解码器生成相应的边界框，该方法在医学短语定位任务上的表现优于现有最先进技术。