Chart question answering (CQA) is a newly proposed visual question answering
(VQA) task where an algorithm must answer questions about data visualizations,
e.g. bar charts, pie charts, and line graphs. CQA requires capabilities that
natural-image VQA algorithms lack: fine-grained measurements, optical character
recognition, and handling out-of-vocabulary words in both questions and
answers. Without modifications, state-of-the-art VQA algorithms perform poorly
on this task. Here, we propose a novel CQA algorithm called parallel recurrent
fusion of image and language (PReFIL). PReFIL first learns bimodal embeddings
by fusing question and image features and then intelligently aggregates these
learned embeddings to answer the given question. Despite its simplicity, PReFIL
greatly surpasses state-of-the art systems and human baselines on both the
FigureQA and DVQA datasets. Additionally, we demonstrate that PReFIL can be
used to reconstruct tables by asking a series of questions about a chart.

该研究提出了一种名为 PReFIL 的算法，通过融合图像和语言特征来智能地回答关于数据可视化的图表的问题，达到了优于现有系统和人类基线的效果，并且还能够通过一系列问题对图表进行重构。