Sepsis is a leading cause of death in the ICU. It is a disease requiring
complex interventions in a short period of time, but its optimal treatment
strategy remains uncertain. Evidence suggests that the practices of currently
used treatment strategies are problematic and may cause harm to patients. To
address this decision problem, we propose a new medical decision model based on
historical data to help clinicians recommend the best reference option for
real-time treatment. Our model combines offline reinforcement learning and deep
reinforcement learning to solve the problem of traditional reinforcement
learning in the medical field due to the inability to interact with the
environment, while enabling our model to make decisions in a continuous
state-action space. We demonstrate that, on average, the treatments recommended
by the model are more valuable and reliable than those recommended by
clinicians. In a large validation dataset, we find out that the patients whose
actual doses from clinicians matched the decisions made by AI has the lowest
mortality rates. Our model provides personalized and clinically interpretable
treatment decisions for sepsis to improve patient care.

提出一种基于历史数据的新型医疗决策模型，使用深度强化学习解决了传统去强化学习中与环境交互的问题，能够进行连续状态 - 行动决策空间中的决策，建议的治疗方案比临床医生建议的更具价值和可靠性，能够提供个性化和可解释的抗感染治疗决策，进而提高患者的护理水平。