The adoption of Vision Transformers (ViTs) based architectures represents a
significant advancement in 3D Medical Image (MI) segmentation, surpassing
traditional Convolutional Neural Network (CNN) models by enhancing global
contextual understanding. While this paradigm shift has significantly enhanced
3D segmentation performance, state-of-the-art architectures require extremely
large and complex architectures with large scale computing resources for
training and deployment. Furthermore, in the context of limited datasets, often
encountered in medical imaging, larger models can present hurdles in both model
generalization and convergence. In response to these challenges and to
demonstrate that lightweight models are a valuable area of research in 3D
medical imaging, we present SegFormer3D, a hierarchical Transformer that
calculates attention across multiscale volumetric features. Additionally,
SegFormer3D avoids complex decoders and uses an all-MLP decoder to aggregate
local and global attention features to produce highly accurate segmentation
masks. The proposed memory efficient Transformer preserves the performance
characteristics of a significantly larger model in a compact design.
SegFormer3D democratizes deep learning for 3D medical image segmentation by
offering a model with 33x less parameters and a 13x reduction in GFLOPS
compared to the current state-of-the-art (SOTA). We benchmark SegFormer3D
against the current SOTA models on three widely used datasets Synapse, BRaTs,
and ACDC, achieving competitive results. Code:
this https URL

SegFormer3D 是一种记忆高效的分层 Transformer，在 3D 医学图像分割中拥有比当前最先进模型更少的参数和更低的 GFLOPS，并在 Synapse、BRaTs 和 ACDC 等广泛使用的数据集上取得竞争性结果。