In this paper, we present a new question-answering (QA) based key-value pair
extraction approach, called KVPFormer, to robustly extracting key-value
relationships between entities from form-like document images. Specifically,
KVPFormer first identifies key entities from all entities in an image with a
Transformer encoder, then takes these key entities as \textbf{questions} and
feeds them into a Transformer decoder to predict their corresponding
\textbf{answers} (i.e., value entities) in parallel. To achieve higher answer
prediction accuracy, we propose a coarse-to-fine answer prediction approach
further, which first extracts multiple answer candidates for each identified
question in the coarse stage and then selects the most likely one among these
candidates in the fine stage. In this way, the learning difficulty of answer
prediction can be effectively reduced so that the prediction accuracy can be
improved. Moreover, we introduce a spatial compatibility attention bias into
the self-attention/cross-attention mechanism for \Ours{} to better model the
spatial interactions between entities. With these new techniques, our proposed
\Ours{} achieves state-of-the-art results on FUNSD and XFUND datasets,
outperforming the previous best-performing method by 7.2\% and 13.2\% in F1
score, respectively.

本文提出了一种新的基于问题回答的键值对提取方法 KVPFormer，使用 Transformer 编码器识别关键实体，通过 Transformer 解码器预测对应的答案，并进一步提出了粗细阶段答案预测方法和空间兼容性注意力偏差方法，从而在 FUNSD 和 XFUND 数据集上取得了优于先前最佳方法的 7.2％和 13.2％的 F1 得分，获得最新的结果。