Is it possible to develop an "AI Pathologist" to pass the board-certified
examination of the American Board of Pathology? To achieve this goal, the first
step is to create a visual question answering (VQA) dataset where the AI agent
is presented with a pathology image together with a question and is asked to
give the correct answer. Our work makes the first attempt to build such a
dataset. Different from creating general-domain VQA datasets where the images
are widely accessible and there are many crowdsourcing workers available and
capable of generating question-answer pairs, developing a medical VQA dataset
is much more challenging. First, due to privacy concerns, pathology images are
usually not publicly available. Second, only well-trained pathologists can
understand pathology images, but they barely have time to help create datasets
for AI research. To address these challenges, we resort to pathology textbooks
and online digital libraries. We develop a semi-automated pipeline to extract
pathology images and captions from textbooks and generate question-answer pairs
from captions using natural language processing. We collect 32,799 open-ended
questions from 4,998 pathology images where each question is manually checked
to ensure correctness. To our best knowledge, this is the first dataset for
pathology VQA. Our dataset will be released publicly to promote research in
medical VQA.

本研究论文旨在探讨是否可以培养出一个 AI 病理学家，以通过美国病理学委员会认证考试，在此目标下，研究第一步是创造一个视觉问答数据集，本文将尝试构建一个病理 VQA 数据集，用自然语言处理等方法从病理学教科书和在线数字库中提取病理图像和标题，并生成问答对，最终收集了 32,799 个来自 4,998 个病理图像的开放性问题，这是公开发布的第一个用于病理学 VQA 的数据集。