In this work we present DREAM, an fMRI-to-image method for reconstructing
viewed images from brain activities, grounded on fundamental knowledge of the
human visual system. We craft reverse pathways that emulate the hierarchical
and parallel nature of how humans perceive the visual world. These tailored
pathways are specialized to decipher semantics, color, and depth cues from fMRI
data, mirroring the forward pathways from visual stimuli to fMRI recordings. To
do so, two components mimic the inverse processes within the human visual
system: the Reverse Visual Association Cortex (R-VAC) which reverses pathways
of this brain region, extracting semantics from fMRI data; the Reverse Parallel
PKM (R-PKM) component simultaneously predicting color and depth from fMRI
signals. The experiments indicate that our method outperforms the current
state-of-the-art models in terms of the consistency of appearance, structure,
and semantics. Code will be made publicly available to facilitate further
research in this field.

DREAM 是一种基于人类视觉系统的基础知识的 fMRI 到图像的重构方法，通过模拟人类感知视觉世界的分层和并行特性来构建逆向路径，利用专门的路径从 fMRI 数据中提取语义、颜色和深度线索。实验证明，该方法在外观、结构和语义的一致性方面优于当前最先进的模型。