The problem of how to assess cross-modality medical image synthesis has been
largely unexplored. The most used measures like PSNR and SSIM focus on
analyzing the structural features but neglect the crucial lesion location and
fundamental k-space speciality of medical images. To overcome this problem, we
propose a new metric K-CROSS to spur progress on this challenging problem.
Specifically, K-CROSS uses a pre-trained multi-modality segmentation network to
predict the lesion location, together with a tumor encoder for representing
features, such as texture details and brightness intensities. To further
reflect the frequency-specific information from the magnetic resonance imaging
principles, both k-space features and vision features are obtained and employed
in our comprehensive encoders with a frequency reconstruction penalty. The
structure-shared encoders are designed and constrained with a similarity loss
to capture the intrinsic common structural information for both modalities. As
a consequence, the features learned from lesion regions, k-space, and
anatomical structures are all captured, which serve as our quality evaluators.
We evaluate the performance by constructing a large-scale cross-modality
neuroimaging perceptual similarity (NIRPS) dataset with 6,000 radiologist
judgments. Extensive experiments demonstrate that the proposed method
outperforms other metrics, especially in comparison with the radiologists on
NIRPS.

通过引入预训练的多模态分割网络用于预测病变位置，以及肿瘤编码器用于表示特征，如纹理细节和亮度强度，结合使用 k 空间特征和视觉特征的全面编码器和频率重建惩罚，采用结构共享编码器和相似性损失，本研究提出了一种新的指标 K-CROSS 用于评估跨模态医学图像合成，通过构建一个包含 6,000 名放射科医生判断的大规模跨模态神经影像感知相似度（NIRPS）数据集，广泛的实验证明了该方法相较于其他指标的性能优越，特别是在 NIRPS 上与放射科医生的比较中。