The rapid spread of information through mobile devices and media has led to
the widespread of false or deceptive news, causing significant concerns in
society. Among different types of misinformation, image repurposing, also known
as out-of-context misinformation, remains highly prevalent and effective.
However, current approaches for detecting out-of-context misinformation often
lack interpretability and offer limited explanations. In this study, we propose
a logic regularization approach for out-of-context detection called LOGRAN
(LOGic Regularization for out-of-context ANalysis). The primary objective of
LOGRAN is to decompose the out-of-context detection at the phrase level. By
employing latent variables for phrase-level predictions, the final prediction
of the image-caption pair can be aggregated using logical rules. The latent
variables also provide an explanation for how the final result is derived,
making this fine-grained detection method inherently explanatory. We evaluate
the performance of LOGRAN on the NewsCLIPpings dataset, showcasing competitive
overall results. Visualized examples also reveal faithful phrase-level
predictions of out-of-context images, accompanied by explanations. This
highlights the effectiveness of our approach in addressing out-of-context
detection and enhancing interpretability.

通过使用逻辑正则化方法对文本的短语级别进行预测，我们提出了一种用于检测上下文错误的逻辑正则化方法（LOGRAN），该方法在解释性和结果准确性方面表现出竞争力，提高了对虚假信息的检测和理解能力。