Background/Aim. This study aims to predict Amyloid Positron Emission
Tomography (AmyloidPET) status with multimodal retinal imaging and
convolutional neural networks (CNNs) and to improve the performance through
pretraining with synthetic data. Methods. Fundus autofluorescence, optical
coherence tomography (OCT), and OCT angiography images from 328 eyes of 59
AmyloidPET positive subjects and 108 AmyloidPET negative subjects were used for
classification. Denoising Diffusion Probabilistic Models (DDPMs) were trained
to generate synthetic images and unimodal CNNs were pretrained on synthetic
data and finetuned on real data or trained solely on real data. Multimodal
classifiers were developed to combine predictions of the four unimodal CNNs
with patient metadata. Class activation maps of the unimodal classifiers
provided insight into the network's attention to inputs. Results. DDPMs
generated diverse, realistic images without memorization. Pretraining unimodal
CNNs with synthetic data improved AUPR at most from 0.350 to 0.579. Integration
of metadata in multimodal CNNs improved AUPR from 0.486 to 0.634, which was the
best overall best classifier. Class activation maps highlighted relevant
retinal regions which correlated with AD. Conclusion. Our method for generating
and leveraging synthetic data has the potential to improve AmyloidPET
prediction from multimodal retinal imaging. A DDPM can generate realistic and
unique multimodal synthetic retinal images. Our best performing unimodal and
multimodal classifiers were not pretrained on synthetic data, however
pretraining with synthetic data slightly improved classification performance
for two out of the four modalities.

用多模态视网膜成像和卷积神经网络预测淀粉样蛋白阳性发射计算机断层扫描（AmyloidPET）状态，并通过合成数据预训练以提高性能。

生成人工智能在眼科学中的应用：使用卷积神经网络进行多模态视网膜图像诊断阿尔茨海默病

Generative artificial intelligence in ophthalmology: multimodal retinal  images for the diagnosis of Alzheimer's disease with convolutional neural  networks