Context plays an important role in visual recognition. Recent studies have
shown that visual recognition networks can be fooled by placing objects in
inconsistent contexts (e.g., a cow in the ocean). To model the role of
contextual information in visual recognition, we systematically investigated
ten critical properties of where, when, and how context modulates recognition,
including the amount of context, context and object resolution, geometrical
structure of context, context congruence, and temporal dynamics of contextual
modulation. The tasks involved recognizing a target object surrounded with
context in a natural image. As an essential benchmark, we conducted a series of
psychophysics experiments where we altered one aspect of context at a time, and
quantified recognition accuracy. We propose a biologically-inspired
context-aware object recognition model consisting of a two-stream architecture.
The model processes visual information at the fovea and periphery in parallel,
dynamically incorporates object and contextual information, and sequentially
reasons about the class label for the target object. Across a wide range of
behavioral tasks, the model approximates human level performance without
retraining for each task, captures the dependence of context enhancement on
image properties, and provides initial steps towards integrating scene and
object information for visual recognition. All source code and data are
publicly available: this https URL

该论文提出了一个生物学上启发的上下文感知对象识别模型，该模型由双流体系结构组成，动态地整合对象和上下文信息，并顺序推理目标对象的类标签，该模型不需要为每个任务重新训练，在各种行为任务中近似人类水平性能，捕捉上下文增强对图像属性的依赖性，并提供了整合场景和对象信息进行视觉识别的初始步骤。