Identifying and reconstructing what we see from brain activity gives us a
special insight into investigating how the biological visual system represents
the world. While recent efforts have achieved high-performance image
classification and high-quality image reconstruction from brain signals
collected by Functional Magnetic Resonance Imaging (fMRI) or
magnetoencephalogram (MEG), the expensiveness and bulkiness of these devices
make relevant applications difficult to generalize to practical applications.
On the other hand, Electroencephalography (EEG), despite its advantages of ease
of use, cost-efficiency, high temporal resolution, and non-invasive nature, has
not been fully explored in relevant studies due to the lack of comprehensive
datasets. To address this gap, we introduce EEG-ImageNet, a novel EEG dataset
comprising recordings from 16 subjects exposed to 4000 images selected from the
ImageNet dataset. EEG-ImageNet consists of 5 times EEG-image pairs larger than
existing similar EEG benchmarks. EEG-ImageNet is collected with image stimuli
of multi-granularity labels, i.e., 40 images with coarse-grained labels and 40
with fine-grained labels. Based on it, we establish benchmarks for object
classification and image reconstruction. Experiments with several commonly used
models show that the best models can achieve object classification with
accuracy around 60% and image reconstruction with two-way identification around
64%. These results demonstrate the dataset's potential to advance EEG-based
visual brain-computer interfaces, understand the visual perception of
biological systems, and provide potential applications in improving machine
visual models.

通过脑活动识别和重建我们所看到的内容，可以深入研究生物视觉系统如何代表世界。本文介绍了 EEG-ImageNet，一个包括从 16 名受试者记录的来自 ImageNet 数据集中的 4000 个图像的新颖 EEG 数据集，该数据集为目标分类和图像重建建立了基准。实验结果表明该数据集有助于推动基于脑电图的视觉脑 - 计算机界面，理解生物系统的视觉知觉，并在改进机器视觉模型方面有潜在应用。