In recent years, "U-shaped" neural networks featuring encoder and decoder
structures have gained popularity in the field of medical image segmentation.
Various variants of this model have been developed. Nevertheless, the
evaluation of these models has received less attention compared to model
development. In response, we propose a comprehensive method for evaluating
medical image segmentation models for multi-indicator and multi-organ (named
MIMO). MIMO allows models to generate independent thresholds which are then
combined with multi-indicator evaluation and confidence estimation to screen
and measure each organ. As a result, MIMO offers detailed information on the
segmentation of each organ in each sample, thereby aiding developers in
analyzing and improving the model. Additionally, MIMO can produce concise
usability and comprehensiveness scores for different models. Models with higher
scores are deemed to be excellent models, which is convenient for clinical
evaluation. Our research tests eight different medical image segmentation
models on two abdominal multi-organ datasets and evaluates them from four
perspectives: correctness, confidence estimation, Usable Region and MIMO.
Furthermore, robustness experiments are tested. Experimental results
demonstrate that MIMO offers novel insights into multi-indicator and
multi-organ medical image evaluation and provides a specific and concise
measure for the usability and comprehensiveness of the model. Code:
this https URL

本研究提出了一种全面的评估医学图像分割模型的方法，名为 MIMO，它允许模型生成独立的阈值，然后与多指标评估和置信度估计相结合，对每个器官进行筛选和测量。实验结果表明，MIMO 为多指标和多器官医学图像评估提供了新的见解，并为模型的可用性和全面性提供了明确的度量。