Human tissue and its constituent cells form a microenvironment that is
fundamentally three-dimensional (3D). However, the standard-of-care in
pathologic diagnosis involves selecting a few two-dimensional (2D) sections for
microscopic evaluation, risking sampling bias and misdiagnosis. Diverse methods
for capturing 3D tissue morphologies have been developed, but they have yet had
little translation to clinical practice; manual and computational evaluations
of such large 3D data have so far been impractical and/or unable to provide
patient-level clinical insights. Here we present Modality-Agnostic Multiple
instance learning for volumetric Block Analysis (MAMBA), a deep-learning-based
platform for processing 3D tissue images from diverse imaging modalities and
predicting patient outcomes. Archived prostate cancer specimens were imaged
with open-top light-sheet microscopy or microcomputed tomography and the
resulting 3D datasets were used to train risk-stratification networks based on
5-year biochemical recurrence outcomes via MAMBA. With the 3D block-based
approach, MAMBA achieves an area under the receiver operating characteristic
curve (AUC) of 0.86 and 0.74, superior to 2D traditional single-slice-based
prognostication (AUC of 0.79 and 0.57), suggesting superior prognostication
with 3D morphological features. Further analyses reveal that the incorporation
of greater tissue volume improves prognostic performance and mitigates risk
prediction variability from sampling bias, suggesting the value of capturing
larger extents of heterogeneous 3D morphology. With the rapid growth and
adoption of 3D spatial biology and pathology techniques by researchers and
clinicians, MAMBA provides a general and efficient framework for 3D weakly
supervised learning for clinical decision support and can help to reveal novel
3D morphological biomarkers for prognosis and therapeutic response.

人体组织和其组成的细胞形成的微环境本质上是三维的。我们提出了用于处理来自多种成像模态的 3D 组织图像并预测患者结果的基于深度学习的平台 MAMBA。MAMBA 通过 3D 基于块的方法，在预测方面表现出比传统的基于单层切片的预测方法更好的性能，暗示着使用 3D 形态特征进行更准确的预测。MAMBA 为临床决策支持提供了一种通用有效的 3D 弱监督学习框架，可以帮助揭示新的 3D 形态生物标志物以进行预后和治疗反应的研究。