Blind detection of the forged regions in digital images is an effective
authentication means to counter the malicious use of local image editing
techniques. Existing encoder-decoder forensic networks overlook the fact that
detecting complex and subtle tampered regions typically requires more feedback
information. In this paper, we propose a Progressive FeedbACk-enhanced
Transformer (ProFact) network to achieve coarse-to-fine image forgery
localization. Specifically, the coarse localization map generated by an initial
branch network is adaptively fed back to the early transformer encoder layers
for enhancing the representation of positive features while suppressing
interference factors. The cascaded transformer network, combined with a
contextual spatial pyramid module, is designed to refine discriminative
forensic features for improving the forgery localization accuracy and
reliability. Furthermore, we present an effective strategy to automatically
generate large-scale forged image samples close to real-world forensic
scenarios, especially in realistic and coherent processing. Leveraging on such
samples, a progressive and cost-effective two-stage training protocol is
applied to the ProFact network. The extensive experimental results on nine
public forensic datasets show that our proposed localizer greatly outperforms
the state-of-the-art on the generalization ability and robustness of image
forgery localization. Code will be publicly available at
this https URL

我们提出了一种 Progressive FeedbACk-enhanced Transformer (ProFact) 网络，用于实现粗细图像伪造定位。该网络通过自适应反馈，将初步分支网络生成的粗定位图传递给早期 Transformer 编码层，以增强正特征的表达并抑制干扰因素。结合上下文空间金字塔模块的级联变压器网络用于改进鉴别式法庭特征，提高伪造定位的准确性和可靠性。实验结果表明，我们提出的定位器在图像伪造定位的泛化能力和稳健性方面远远超过现有技术。