The rapidly developing Large Vision Language Models (LVLMs) have shown
notable capabilities on a range of multi-modal tasks, but still face the
hallucination phenomena where the generated texts do not align with the given
contexts, significantly restricting the usages of LVLMs. Most previous work
detects and mitigates hallucination at the coarse-grained level or requires
expensive annotation (e.g., labeling by proprietary models or human experts).
To address these issues, we propose detecting and mitigating hallucinations in
LVLMs via fine-grained AI feedback. The basic idea is that we generate a
small-size sentence-level hallucination annotation dataset by proprietary
models, whereby we train a hallucination detection model which can perform
sentence-level hallucination detection, covering primary hallucination types
(i.e., object, attribute, and relationship). Then, we propose a
detect-then-rewrite pipeline to automatically construct preference dataset for
training hallucination mitigating model. Furthermore, we propose
differentiating the severity of hallucinations, and introducing a Hallucination
Severity-Aware Direct Preference Optimization (HSA-DPO) for mitigating
hallucination in LVLMs by incorporating the severity of hallucinations into
preference learning. Extensive experiments demonstrate the effectiveness of our
method.

通过细粒度人工智能反馈，检测和减轻大规模视觉语言模型中的幻觉现象。通过生成小规模句子级幻觉注释数据集和使用检测 - 重写流程来自动构建偏好数据集，进一步区分幻觉的严重程度，将幻觉严重程度纳入偏好学习来减轻大规模视觉语言模型中的幻觉。广泛实验证明了我们方法的有效性。