With the rapid advancement of Vision Language Models (VLMs), VLM-based Image
Quality Assessment (IQA) seeks to describe image quality linguistically to
align with human expression and capture the multifaceted nature of IQA tasks.
However, current methods are still far from practical usage. First, prior works
focus narrowly on specific sub-tasks or settings, which do not align with
diverse real-world applications. Second, their performance is sub-optimal due
to limitations in dataset coverage, scale, and quality. To overcome these
challenges, we introduce Depicted image Quality Assessment in the Wild
(DepictQA-Wild). Our method includes a multi-functional IQA task paradigm that
encompasses both assessment and comparison tasks, brief and detailed responses,
full-reference and non-reference scenarios. We introduce a
ground-truth-informed dataset construction approach to enhance data quality,
and scale up the dataset to 495K under the brief-detail joint framework.
Consequently, we construct a comprehensive, large-scale, and high-quality
dataset, named DQ-495K. We also retain image resolution during training to
better handle resolution-related quality issues, and estimate a confidence
score that is helpful to filter out low-quality responses. Experimental results
demonstrate that DepictQA-Wild significantly outperforms traditional
score-based methods, prior VLM-based IQA models, and proprietary GPT-4V in
distortion identification, instant rating, and reasoning tasks. Our advantages
are further confirmed by real-world applications including assessing the
web-downloaded images and ranking model-processed images. Datasets and codes
will be released in this https URL

基于 Depicted Image Quality Assessment in the Wild (DepictQA-Wild) 方法构建了一个多功能的图像质量评估任务范式，包括评估和比较任务，从而构建了一个全面、大规模且高质量的数据集 DQ-495K，结果显示 DepictQA-Wild 在失真识别、即时评分和推理任务中明显优于传统基于分数的方法、之前的基于 Vision Language Models 的图像质量评估模型和专有的 GPT-4V。